Data Engineer at Archigos Solutions
Archigos Solutions · Bengaluru, India · Posted today
About this role
Archigos Solutions is seeking an experienced Data Engineer to design and optimize scalable data pipelines and real-time streaming solutions. You will develop batch and streaming pipelines, implement Spark Structured Streaming solutions, manage Kafka ingestion, and apply Medallion Architecture principles. This role requires expertise in Apache Kafka, Databricks, and performance optimization with a focus on data governance and schema enforcement.
Skills required
Key responsibilities
Design and develop scalable batch and streaming data pipelines using Apache Spark and Kafka
Implement Spark Structured Streaming solutions for real-time data processing
Manage Kafka ingestion and optimize data flow across systems
Apply Medallion Architecture patterns for data organization and governance
Perform performance optimization and enforce data quality standards through schema management
About Archigos Solutions
Archigos Solutions is a forward-thinking technology company specializing in data engineering and analytics solutions. The company fosters a collaborative environment where engineers can work on cutting-edge data infrastructure projects. They are committed to building scalable systems that drive business intelligence and real-time insights.
Why you should apply
Work with cutting-edge technologies including Databricks, Apache Kafka, and Spark Structured Streaming
Opportunity to design and optimize scalable data pipelines for real-time processing at enterprise scale
Immediate to 15 days notice period allows for quick onboarding and immediate impact
Interview preparation tips
Prepare detailed examples of streaming pipelines you have built using Spark Structured Streaming or similar technologies
Be ready to discuss your experience with Kafka architecture, partitioning strategies, and consumer group management
Demonstrate knowledge of Medallion Architecture and how you would implement bronze, silver, and gold layers
Discuss performance optimization techniques you have applied to reduce latency and improve throughput in data systems
Career growth path
Ready to apply?
Keep your updated resume, transcripts, and cover letter ready before you start the application.
Apply via Email: tejasveer@archigossolutions.com
Check the official careers page for deadline and instructions
Frequently asked questions
Get free daily IT job alerts
Join thousands of IT professionals getting daily job updates on WhatsApp and Telegram.
Disclaimer: Job details are sourced from public postings. Please verify all information on the official company website before applying.
View Comments
Data science