Specialist Spark / Delta Lake (m/f/d)
Freelance/Contracting project Dresden Start date: asap Reference number: 766989/1
Diesen Job teilen oder drucken
Your responsibilities
1. Designing a data warehouse (including different storage technologies, appropriate file system, Hardware footprint optimization, …)
2. Exposure to big scale projects in similar industries, where data correctness and completeness is highly important
3. Deployments in private cloud (using Kubernetes, docker images, …)
4. Few Keywords: Spark, Delta Lake, Iceberg, Apache Hudi, Graph Database, HDFS, Parquet,
Your profile
5. Experience & Seniority with Java (as main programming language)
6. Proven experience in Data Engineering and Date Warehouse
7. Experience with storing and reading big amount of data, including read/write performance tuning (across databases), hands-on with concrete real project situations
8. Kow how in Spark, Delta Lake, Iceberg, Apache Hudi, Graph Database, HDFS, Parquet,
Your benefits
9. Long term engagement