Data Engineer/Python Developer/Remote
Dice is the leading career destination for tech experts at every stage of their careers. Our client, Apetan Consulting, is seeking the following. Apply via Dice today!Key Responsibilities
- Design, build, and maintain ETL/ELT data pipelines
- Develop Python-based data processing applications
- Work with structured and unstructured data at scale
- Integrate data from multiple sources (APIs, databases, files, streams)
- Optimize data workflows for performance and reliability
- Ensure data quality, validation, and monitoring
- Collaborate with data scientists, analysts, and backend teams
- Manage and maintain data warehouses/lakes
- Implement logging, error handling, and automation
- Follow best practices for security and compliance
- Strong Python (Pandas, NumPy, PySpark)
- Writing clean, modular, and testable code
- SQL (PostgreSQL, MySQL, SQL Server)
- NoSQL (MongoDB, Cassandra optional)
- Data Warehouses (Snowflake, Redshift, BigQuery)
- Apache Spark, Hadoop (preferred)
- Batch and streaming data processing
- AWS / Azure / Google Cloud Platform
- S3, Lambda, Glue, Dataflow, BigQuery, etc.
- Airflow, Prefect, Luigi (orchestration)
- Kafka / PubSub (streaming optional)
- DBT (data transformation)
- Git, CI/CD
- Docker, Kubernetes (nice to have)
- Linux basics