[Remote] Manager - Data Engineering
Note: The job is a remote job and is open to candidates in USA. Tredence Inc. is a data and analytics company, and they are seeking a Manager - Data Engineering to oversee the delivery of data solutions. The role involves managing data pipeline architecture, optimizing processes, and ensuring operational effectiveness of the enterprise data platform.
Responsibilities
- Manage end to end delivery by Investigating problem areas, working cross-functionally with product manager and other stakeholders
- Follow the Agile development methodology; think strategically and execute methodically
- Develop and manage capacity and growth projection forecasts of the environment within budgets
- Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional / non-functional business requirements
- Drive optimization, testing and tooling to improve quality of solutions
- Manage teams that build and operate high volume distributed systems in a SaaS environment
- Devise efficient processes that increase velocity and quality
- Train counterparts in the data pipelining and preparation techniques, which make it easier for them to integrate and consume the data they need for their own use cases
- Promote the available data and analytics capabilities and expertise to business unit leaders and educate them in leveraging these capabilities in achieving their business goals
- Ensure operational effectiveness in performance, uptime, release management of the enterprise data platform
Skills
- Bachelor's degree (or foreign equivalent) in Information Technology, or a related field
- Five (5) years of experience in the job offered or a related position
- Demonstrable knowledge of: Azure Databricks
- Demonstrable knowledge of: PySpark
- Demonstrable knowledge of: Python
- Demonstrable knowledge of: Azure Data Factory (ADF)
- Demonstrable knowledge of: Data warehousing, ETL
- Demonstrable knowledge of: Azure DevOps
- Demonstrable knowledge of: Teradata
- Demonstrable knowledge of: Vantage
- Demonstrable knowledge of: UNIX
- Demonstrable knowledge of: Azure Storage Account (ADLS)
- Demonstrable knowledge of: Azure Event Hub
- Demonstrable knowledge of: Kafka
- Travel to unanticipated client locations throughout the U.S., approximately 30%, as required
- May telecommute from any location within the U.S
Company Overview
Company H1B Sponsorship