1

Musical notes

Musical notes videos

Piano

Can AI, Machine learning, Data science, Computer vision, image processing technologies assist in interpreting musical notes ?

Input dataset : Musical notes

Output : Sound played.

A python program which can assist in interpreting or converting text to speech ?.

The text inputted is Musical notes captured as a image by camera as input device.

Prashant Akerkar
  • 139
  • 5

2 Answers2

4

AI/ML can solve the task described, a solution is as below:

  • Regular image processing algorithm (pixel row with min black pixels, adjacent rows are considered as 1) to split the sheet music (as image) into rows (red lines)
    enter image description here
  • Regular image processing algorithm (pixel column with min black pixels, adjacent columns are considered as 1) to split a row into notes based on scanning vertically (blue lines)
    enter image description here
  • Do image classification on every cell created by red lines and blue lines to get notes, and play them
  • Real-time image classification may be slow and not possible to play note by note directly, the programme should process the whole sheet music first.
Dan D
  • 1,318
  • 1
  • 14
  • 39
2

LMGTFY ;)

The problem is called Optical Music Recognition. Here you can find tutorial that desribes OMR with deep learning and here you have scientific paper. I think it is very good start for your investigations.

Slawomir Orlowski
  • 131
  • 4