AM / SailPoint Security Engineer
October 9, 2026Oracle Fusion Technical Consultant
October 13, 2026
Full-Time, Remote
Posted 2 weeks ago
Experience: 5+ Years
Budget: 1L-1.2L
JD:
Job Overview
We are looking for an experienced Data Solution Engineer with strong expertise in Python (PySpark), Scala, data pipeline development, API development, big data technologies, and cloud platforms.
Key Responsibilities
- Develop scalable batch and streaming data pipelines using Python, PySpark, Scala, and Apache Spark.
- Work with Databricks, GCP (BigQuery, Dataproc), and Azure Blob Storage.
- Implement lakehouse solutions using Delta Lake, Apache Iceberg, and Apache Hudi.
- Build pipelines using Kafka, Azure Event Hubs, Google Cloud Pub/Sub, and Airflow on Kubernetes.
- Design data models and work with SQL/NoSQL databases, including Cosmos DB and Redis.
- Use Terraform for infrastructure automation and optimize Spark performance and cloud costs.
- Implement data quality, testing, lineage, monitoring, and observability.
- Support ML pipelines and MLOps using MLflow or equivalent tools.
- Use AI coding assistants such as GitHub Copilot or Claude Code.
Mandatory Skills
Python (PySpark), Scala, Apache Spark, Databricks, GCP, BigQuery, Dataproc, Delta Lake, Iceberg, Hudi, Kafka, Airflow, Kubernetes, Terraform, SQL/NoSQL, data pipeline testing, and MLOps.
Good to Have: Experience with Adobe Analytics or Google Analytics.
