Jubil ID: 238

Company: Amazon Web Services

Location: Austin, TX

Description:
Why Valvoline Global Operations?At Valvoline Global Operations
we’re proud to be The Original Motor Oil
but we’ve never rested on being first. Founded in 1866
we introduced the world’s first branded motor oil
staking our claim as a pioneer in the automotive and industrial solutions industry. Today
as an affiliate of Aramco
one of the world’s largest integrated energy and chemicals companie

Qualifications:
Acting with unwavering integrity Striving for excellence in all endeavors BS in Computer Science
IT
Software or Computer Engineering
Data Science or Analytics
Mathematics or related field 3-5 years of data engineering experience Experience in designing
building
and maintaining data warehouses Understanding of data modeling
data warehousing
and data lake concepts Proficiency in programming languages such as Python
Java
Scala
and scripting languages like Bash or PowerShell Experience with big data technologies
such as Apache Hadoop
Spark
Kafka
and others Proficiency in AWS cloud services and Databricks Proficiency in SQL and experience with relational databases Experience in building and optimizing big data pipelines
architectures
and data sets Familiarity with ETL tools
processes
and data integration techniques Excellent communication and team collaboration skills Hands-on experience deploying and monitoring machine learning models for business-critical use cases

Benefits:
Delivering on our commitments with passion Collaborating as one unified team

Responsibilities:
Data Engineer plays a crucial role in designing
implementing
and managing advanced data solutions using both AWS and Data Lakehouse platforms This position requires a blend of skills in cloud computing
data engineering
and analytics Responsible for optimizing performance
ensuring security and compliance
and providing support and troubleshooting Collaboration with data scientists and analysts is also key
ensuring the platform meets analytics needs while staying updated with the latest technologies and practices in the field Design and implement scalable and efficient data pipelines using AWS and Data Lakehouse Platform services Leverage AWS cloud services like S3
Redshift
EMR
Glue
Lambda
and others in combination with Data Lakehouse platform/Apache Spark Integration for advanced data processing and analytics Collaborate with cross-functional teams to understand business needs and translate them into technical solutions Utilize Databricks for big data processing and streaming analytics Develop and maintain data lakes and data warehouses on AWS and Data Lakehouse Platform
ensuring data integrity and accessibility Optimize data storage and processing for performance and cost efficiency Automate data workflows and ensure high data quality and reliability Monitor
troubleshoot
and resolve data pipeline issues Organizing and managing data within the environment
ensuring stored efficiently
securely
and in a manner that supports easy access and analysis Monitor the performance of data processes and queries and optimize for efficiency and speed Ensure high standards of data quality and implement data governance practices Stay current with emerging trends and technologies in cloud computing
big data
and data engineering Provide ongoing support for the platform
troubleshoot any issues that arise
and ensure high availability and reliability of data infrastructure Create documentation for the platform infrastructure and processes
and train other team members or users in platform effectively Collaborate with the global pricing team to design scalable
end-to-end data pipelines that integrate diverse pricing data
including market data
currency exchange rates
and competitive intelligence
into a centralized data lake or warehouse.” Work closely with data scientists to deploy machine learning models for price forecasting
price elasticity analysis
and promotional efficacy
ensuring robust model monitoring
version control
and performance optimization on Databricks and AWS Design and implement comprehensive global analytical data models
leveraging star schema architecture to optimize query performance and support high-impact pricing analytics and dashboarding within Power BI Proficiency in administering and integrating Databricks with business intelligence tools such as Power BI
including managing security configurations
optimizing performance
and deploying scalable dashboards