Analyzing recent Data Engineer job offers in the Netherlands from LinkedIn and Indeed, how often do certain technologies get mentioned?
Please view limitations before drawing conclusions out of this project.
I scraped job offers that contained "Data engineer" from both Indeed and LinkedIn.
For each job offer, I count how often certain technologies appear in the job description. I then aggregate these counts per category.
This is not perfect, as some job offers require certain technologies, and some just mention a few as an example.
Also, some job offers might mention a technology in a different way. For example, a job offer mentioning "Azure Data Factory" is also counted for "Azure", even though the job offer might not mention Azure by itself.
However, this analysis gives an indication of what technologies are most requested in the Netherlands.
Some of the most requested technologies are: Python, SQL, Azure, Terraform, Databricks, and Snowflake.
For Big Data Processing, the most requested tools are: Spark, Kafka, and Hadoop.
Why don't you go out and learn them?