Senior Data Engineer, Data Analytics
Insights and Analytics Unit, Sunshine Coast or Moreton Bay Campus Level 8, $ 111,613 - $126,406 p.a., plus up to 17% employer... more info
Big Data Engineer
Salary:
80.00 - 100.00
Posted:
23-02-2025
Category:
Database, Analytics BI
Job Description
· 5+ years experience working in Data Engineering and Warehousing. · 3-5 years’ experience integrating data into analytical platforms. · Experience in ingestion technologies (e.g., Swoop, Flume), processing technologies (Spark/Scala), and storage (e.g., HDFS, HBase, Hive). · Experience in data profiling, source-target mappings, ETL development, SQL optimization, testing, and implementation. · Expertise in streaming frameworks (Kafka/Spark Streaming/Storm) is essential. · Experience in building Spark SQL and Spark Data Frame API-based applications. · Experience managing structured and unstructured data types. · Experience in requirements engineering, solution architecture, design, and development/deployment. · Experience in creating big data or analytics IT solutions. · Track record of implementing databases and data access middleware and high-volume batch and (near) real-time processing. #J-18808-Ljbffr
Job Details
Salary: 80.00 - 100.00
Posted: 23-02-2025
Category: Database, Analytics BI
Related Jobs
AWS Data Engineer
InfoCentric is one of the largest Australian-owned specialist Cloud, Data and Analytics Consulting firms. At InfoCentric,... more info
Data Engineer
Improve upon existing systems that collect, manage and convert data for our teams to interpret in a meaningful way. Experience... more info
