Cloud Data Engineer

Dempsey Resource Management Inc.

3.9-4.6Kد.إ[شهريًا]
في الموقع - مدينة كويزون3-5 سنوات خبرةبكالوريوسدوام كامل
مشاركة

وصف الوظيفة

الوصف

  • Design, build, and maintain cloud-based data pipelines and workflows that support analytics and operational systems.
  • Integrate data from various sources using APIs and cloud services.
  • Develop clean, efficient, and test-driven code in Python for data ingestion and processing.
  • Optimize data storage and retrieval using big data formats like Apache Parquet and ORC.
  • Implement robust data models, including relational, dimensional, and NoSQL models.
  • Collaborate with cross-functional teams to gather and refine requirements and deliver high-quality solutions.
  • Deploy infrastructure using Infrastructure as Code (IaC) tools such as AWS

المتطلبات

  1. At least 3 years in a data engineering role working on data integration, processing, and transformation use cases with open-source languages (i.e. Python) and cloud technologies.
  2. With Strong programming skills in Python specifically for API integration and data libraries,with emphasis on quality and test-driven development.
  3. Demonstrated proficiency with big data storage formats (Apache Parquet, ORC) and practical knowledge of pitfalls and optimization strategies.
  4. Demonstrated proficiency with SQL
  5. Experience with data modeling:
  • Relational modeling
  • Dimensional modeling
  • NoSQL modeling
  1. Working knowledge of IaC on AWS (CloudFormation or CDK)
  2. Working knowledge of AWS Services:
  • Glue, IAM, Lambda, DynamoDb, Step Functions, S3,CloudFormation or CDK
  • Must be willing to work on a hybrid setup, with onsite reporting to Quezon City.
  • Must be available to start by June 1, 2025.
  • Engagement is project-based for 6 months, with a possibility of extension.
  • With experience in Athena, Kinesis, MSK, MWAA, SQS
  1. Experience with orchestration of data flows/pipelines: Apache Airflow or Dagster
  • Experience with data streaming (Kinesis, Kafka)
  • Experience with Apache Spark
  • Client-facing experience, multi-cultural team experience, technical leadership, team leadership
AthenaKinesisMSKSQL
Preview

Maria Palma

Talent Acquisition ManagerDempsey Resource Management Inc.

رد اليوم 6 مرات

موقع العمل

San jose st. St. Group, San Jose, 13 Payatas B, Quezon City, Metro Manila, Philippines

نشر بتاريخ 13 May 2025

الإبلاغ عن هذه الوظيفة

تذكير أمان Bossjob

إذا كانت الوظيفة تتطلب العمل خارج البلاد، يرجى أن تكون متيقظًا وأن تحذر من الاحتيال.

إذا واجهت صاحب عمل قام بالإجراءات التالية أثناء بحثك عن وظيفة، يرجى الإبلاغ عنه فورًا

  • يحجب هويتك،
  • يتطلب منك تقديم ضمان أو يجمع ممتلكات،
  • يجبرك على الاستثمار أو جمع الأموال،
  • يجمع فوائد غير قانونية،
  • أو حالات غير قانونية أخرى.