SAP Business Objects Data Services(BODS) Consultant
July 10, 2026Microsoft Security Architect / Engineer
July 10, 2026
Experience: 8 Year
Budget: 1L-1.6L
JD:
Job Summary
We are seeking a highly skilled and experienced Senior Hadoop Developer / Big Data Engineer with 8+ years of experience to join our dynamic data engineering team. The ideal candidate will have deep expertise in designing, developing, and optimizing large-scale Hadoop ecosystems and data pipelines. You will play a critical role in building robust, scalable, and high-performance data solutions that drive business intelligence and analytics.
Key Responsibilities
As a Senior Hadoop Developer, you will be responsible for designing, developing, and maintaining highly scalable, distributed data applications using the Hadoop ecosystem, including HDFS, MapReduce, YARN, HBase, Hive, Pig, and Spark. You will architect and implement robust ETL (Extract, Transform, Load) pipelines to process massive volumes of structured, semi-structured, and unstructured data.
A significant portion of your role will involve analyzing and optimizing existing Hadoop applications for performance, reliability, and scalability. This includes tuning memory, CPU, and network resources, as well as optimizing Spark jobs and Hive queries. You will also implement data quality checks, validation processes, and ensure data integrity across various stages of the data lifecycle.
We prefer candidates who have experience working on migrating on-premise Hadoop clusters to cloud-based big data platforms (e.g., AWS EMR, Azure HDInsight, GCP Dataproc) and integrating with cloud-native services. You will collaborate closely with Data Scientists, Data Analysts, and Application Developers to understand business requirements and translate them into technical specifications. Additionally, you will provide technical leadership, code reviews, and mentorship to junior and mid-level data engineers. Finally, you will set up monitoring tools to track cluster health, job performance, and data flows, and proactively identify and resolve production issues.
Required Qualifications & Skills
To be considered for this role, you must hold a Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field, and possess a minimum of 8 years of hands-on experience in Big Data technologies, with a strong focus on the Hadoop ecosystem.
| Category | Specific Requirements |
| Core Technologies | Expert-level proficiency in Apache Spark (PySpark, Scala, or SparkSQL) for batch and streaming data processing. Strong experience with Hive (including writing complex HiveQL queries and optimizing them). Solid understanding of HDFS, YARN, and MapReduce concepts. Experience with NoSQL databases such as HBase, Cassandra, or MongoDB. |
| Programming | Proficiency in scripting and programming languages: Python, Scala, or Java. |
| Data Modeling | Experience in designing data warehouses and implementing dimensional data modeling (Star schema, Snowflake schema). |
| Workflow Management | Experience using workflow schedulers like Apache Airflow, Oozie, or Control-M. |
| Cloud Platforms | Hands-on experience with at least one major cloud provider (AWS, Azure, or GCP) and their respective big data services. |
| Version Control | Proficient in using Git for source code management. |
Preferred Qualifications
Candidates who possess experience with real-time data processing frameworks like Apache Kafka and Apache Flink will be given priority. Familiarity with containerization and orchestration tools like Docker and Kubernetes is highly desirable, as is knowledge of CI/CD pipelines for deploying data applications. Experience with advanced security and governance tools like Apache Ranger or Apache Atlas is a plus. We are looking for someone with strong problem-solving skills and the ability to work independently in a fast-paced environment.
What We Offer
•Competitive salary and comprehensive benefits package.
•Opportunity to work on cutting-edge big data technologies and solve complex data challenges.
•A collaborative and innovative work environment with opportunities for professional growth and leadership.
•Flexible work arrangements (if applicable).
