· Build and manage ETL pipelines for reading, cleaning, cataloguing, encrypting and delivery of different datasets.
· Strong Python/Scala and software engineering fundamentals.
· Hadoop or Spark, AWS Glue, EMR, SQL.
· Experience creating and building APIs.
· Cloud technologies (AWS). In particular AWS-Glue, SQS, EC2, S3, RDS.
· DevOps mindset: CI/CD, Apache Airflow, AWS data pipelines, Terraform, GitLab Pipelines
· Elastic Search.
· Linux, Bash, Docker, Kubernetes.
· Statistical techniques and their applications in business
· Test development
Bachelors
B.E
Hadoop or Spark,AWS Glue,EMR,SQL.,
IT-Software- Software services