Picking a Research Topic

Selecting a research topic is a daunting task. Here are some things to help you think through the process.

The first challenge to beginning your research study is finding a topic you are interested in. Then, you must find a niche within that topic that still contains an open research problem. Here, I consider the situation for the Master’s and the PhD.

When considering a Master’s or PhD, your first consideration will be to do a data science problem or a machine learning problem? I think of data science as applying machine learning within a specific domain.

Data Science

One line of consideration can guide you when picking a topic in data science. Your order of interrogation has to be:

  1. Have you got the data, or can you get it?
  2. If the data is publicly available. Has this already been done?
  3. If someone has already done it. What is my contribution or novelty?

We will get to contribution vs novelty shortly.

Machine Learning

In machine learning, the datasets for specific problems, the metrics for comparisons between algorithms, and the methodology to be followed are generally well understood. Here, picking a topic is more about the area of machine learning you would like to contribute to and how you will move it forward.

For instance, if you are doing object detection, there are standardised datasets and standardises metrics for measuring performance on the task. Your contribution or novelty would relate to these datasets, metrics and the existing algorithms for the task.

Research Problem

This conversation brings us to a discussion about novelty and contribution. Remember that even though a master’s unlike a PhD, need not be novel. It should still contribute to the field. Here is a quick discussion of the difference between these two confusing ideas.

Novelty (PhD)

True novelty, the quality of being new, original, or unusual, is rare, even at the PhD level. For example, developing a groundbreaking new algorithm or theoretical framework is challenging and often builds on existing ideas. Worse yet, many seemingly novel ideas have already been explored in some form. The transition from a Master’s, where contribution is key, to a PhD, where novelty is often expected, is a significant leap. Having completed a Master’s, you understand the depth of existing research and how difficult it can be to make contributions, let alone new groundbreaking discoveries.

This challenge highlights the importance of:

  • thorough literature review,
  • creative thinking and
  • collaboration Mentorship.

Example: Developing a new type of neural network architecture that significantly outperforms existing models on a specific task.

Contribution (MSc)

Contribution is the part played in helping something to advance. A Master’s dissertation focuses more on demonstrating a solid grasp of your field and your ability to conduct rigorous research. The emphasis is on showing that you can effectively utilise existing knowledge and tools to generate meaningful results. However, the dissertation should also contribute to the ongoing discourse in your study area. A contribution is often achieved by advancing the field in some way, such as through:

  • Applying existing methods to a new dataset or problem domain. This application expands the understanding of how these methods perform in different contexts.
  • Improving existing methods. This improvement could involve refining an algorithm, optimising parameters, or combining techniques to achieve better results.
  • Conducting a thorough analysis and evaluation. This analysis could include comparing different methods, identifying their strengths and weaknesses, or exploring the impact of different factors on performance.
  • Generating new insights from data. The findings can be valuable even if the methods used are not novel.

Example: Applying a known machine learning model to predict customer churn in a specific industry, analysing the results and identifying key factors contributing to churn.

Next Steps

  1. Look at my research tab for some topics.
  2. Go to my resources tab and create a letter of intent.