[Remote] AWS Data Architect /Cloud Consultant

Note: The job is a remote job and is open to candidates in USA. Vertical Relevance is looking for an AWS Data Consultant to join their team as a full-time employee and work remotely. This role involves planning, building, and deploying software systems, as well as providing technical and strategic guidance to customers on their cloud journey.

Responsibilities

• Help customers shape their journey to adopting the cloud and provide our customers with technical and strategic guidance on their “cloud journey”
• Consult, plan, design, and implement Data solutions on the cloud customers
• Design AWS Data Lake implementations
• Design and Develop AWS Data Quality and Governance solutions
• Become a deep technical resource that earns our customer's trust
• Develop high-quality technical content such as automation tools, reference architectures, and white papers to help our customers build on the cloud
• Innovate on behalf of customers and translate your thoughts into action yielding measurable results
• Support solution development by conveying customer needs and feedback as input to technology roadmaps. Share real world implementation challenges and recommend expansion of capabilities through enhanced and new offerings
• Assist with technical briefs that document solutions
• Assist with reference architecture implementations
• Support internal and external brand development through thought leadership:
• Work with Marketing/Alliances to write blog posts
• Work with Marketing/Alliances to develop internal case studies
• Assist Customer in building out a framework for data collection, data ingestion and catalog, data storage and data serving designed to optimize the efficiency in which information is accessed, curated, served and analyzed from up to two on-premises data sources
• Assist Customer with implementing Amazon Virtual Private Cloud (Amazon VPC), account, Amazon Simple Storage Service (Amazon S3) bucket strategy and capture impact for introducing critical data for a data lake
• Assist Customer with achieving modern big data lambda architecture, providing an environment for consumption and utilization of data coming from either batch or streaming sources
• Assist Customer with defining detailed data architecture including raw data, conformed, structured, enriched, and aggregated
• Provide Customer general best practices in building production quality data pipeline for ingestion, transformation and consumption to downstream applications through a serving layer
• Assist Customer with defining details to data catalog and data serving layer through application program interfaces (APIs) if required
• Provide Customer general best practices for Amazon S3 data storage approach
• Based on Customer’s ingestion requirements provided. Assist Customer with building a reusable ingestion framework to onboard new data quickly based on one data source example
• Assist Customer with designing and building robust data ingestion solutions using monitoring, logging and alerting servicing with retry capabilities
• Assist Customer with server-less approaches where if applicable for the ingestion
• Assist Customer with building the framework for managing data updates to data stored in objects on Amazon S3
• Based on Customer’s ingestion, orchestration and operational requirements. Provide general best practices to Customer for implementing an extensible and supportable orchestration framework for onboarding data to a lambda architecture for a representative data source
• Advise Customer on leveraging AWS Services tools for data ingestion including Amazon Kinesis, Amazon EMR, AWS Lambda or other tool defined as part of the assessment
• Advise Customer on orchestration options on AWS Services including but not limited to AWS Glue, AWS Step Functions, AWS Batch, Amazon EMR, AWS Data Pipeline, AWS Lambda or other AWS native orchestration tooling
• Assist Customer with building out the orchestration and state management processes to support data processing without data loss and exception and identify error handling
• Advise Customer on how the orchestration tooling will provide operational feedback to the support organizations in the event of a failure
• Based on Customer’s usage requirements. Assist Customer with building the data lake storage approach for a representative data source
• Assist Customer with building data storage including buckets, prefixes, encryption, file types, partitioning
• Assist Customer with building automated data partition strategy
• Assist Customer with building Amazon S3 Bucket policies, logging and monitoring
• Assist Customer with building out data lifecycle management
• Assist Customer with building cross-region replication if required

Skills

• 10+ years Professional experience architecting/operating Data / DevOps solutions built on AWS
• Experience in software/technology customer facing experience
• You must be legally authorized to work in the United States without the need for employer sponsorship, now or at any time in the future
• Apache Iceberg Sagemaker, SageMaker Lakehouse, SageMaker Catalog, Terraform
• Athena
• Redshift
• EMR
• Glue
• DataBricks and/or Snowflake
• REDIS

Company Overview

• Vertical Relevance focuses Financial Services, across Wealth Management, Asset Management, Insurance, and Banking. It was founded in 2015, and is headquartered in Croton On Hudson, New York, USA, with a workforce of 51-200 employees. Its website is https://www.verticalrelevance.com/.

Apply tot his job Apply To this Job