Data Engineer at Archigos Solutions
Archigos Solutions · Bengaluru, India · Posted today
About this role
Archigos Solutions is seeking an experienced data engineer to design and optimize scalable data pipelines and real-time streaming solutions. You will develop batch and streaming pipelines, manage Kafka ingestion, and optimize Databricks workflows using medallion architecture principles. This role focuses on data governance, performance tuning, and building robust data infrastructure for enterprise-scale operations.
Skills required
Key responsibilities
Design and develop scalable batch and real-time streaming data pipelines using Apache Kafka and Spark Structured Streaming
Implement medallion architecture with bronze, silver, and gold layers for optimal data organization and quality
Manage Kafka ingestion workflows and optimize Databricks clusters for performance and cost efficiency
Ensure data governance standards, data quality, and implement performance tuning across pipelines
Collaborate with data scientists and analytics teams to deliver reliable data solutions
About Archigos Solutions
Archigos Solutions is a forward-thinking technology company specializing in data engineering and analytics solutions. The company fosters a collaborative environment where engineers work on cutting-edge data infrastructure projects serving enterprise clients across multiple industries.
Why you should apply
Work on cutting-edge real-time streaming and batch processing technologies with industry leaders
Immediate to 15 days notice period flexibility allows quick onboarding for the right candidate
Opportunity to master medallion architecture and advanced Databricks optimization in a professional setting
Interview preparation tips
Prepare detailed examples of streaming pipelines you’ve built with Kafka and Spark, focusing on scalability challenges and solutions
Be ready to explain medallion architecture implementation and how you’ve applied it in real-world projects
Discuss your experience with Databricks optimization, including cluster configuration and cost management strategies
Demonstrate knowledge of SQL and Spark SQL performance tuning techniques with specific use cases
Career growth path
Ready to apply?
Keep your updated resume, transcripts, and cover letter ready before you start the application.
Apply via Email: [email protected]
Check the official careers page for deadline and instructions
Frequently asked questions
Get free daily IT job alerts
Join thousands of IT professionals getting daily job updates on WhatsApp and Telegram.
Disclaimer: Job details are sourced from public postings. Please verify all information on the official company website before applying.
Living here makes finding trustworthy gaming sites a bit tricky but this portal finally gets it right. Local payment methods work perfectly and the live dealers run smoothly even during peak hours. I recommend it to all my friends who want a safe and entertaining experience. cs8casino