Introduction to Workwarp and the Role
Workwarp is a leading company that specializes in providing innovative solutions to enhance business operations. We are currently seeking an experienced Data Engineer to join our team, focusing on Costco Logistics BI. As a Data Engineer, you will play a crucial role in designing, building, and maintaining end-to-end data pipelines to strengthen Costco Logistics reporting. This is an exceptional opportunity to work with a talented team of professionals and contribute to the development of cutting-edge data solutions.
Key Responsibilities
In this role, you will be responsible for developing and operationalizing data pipelines to make data available for consumption. Your key responsibilities will include:
- Designing, building, testing, and automating data pipelines that can be relied upon throughout the organization as the single source of truth
- Collaborating with product owners, engineering, and data platform teams to design, build, test, and automate data pipelines
- Working with data architects and data/BI engineers to design data pipelines and recommend ongoing optimization of data storage, data ingestion, data quality, and orchestration
- Developing and implementing ETL/ELT methods using Informatica Cloud (IICS)
- Utilizing MySQL to enhance and accelerate the delivery of our data products and services
- Leveraging Azure services, including Azure SQL DW (Synapse), ADLS, Azure Event Hub, and Azure Data Factory, to enhance and accelerate the delivery of our data products and services
- Implementing big data and NoSQL solutions by developing scalable data processing architectures to drive high-value insights to the organization
- Identifying, designing, and implementing internal system improvements, automating manual processes, and optimizing data delivery
- Identifying ways to improve data reliability, efficiency, and quality of data management
- Communicating technical requirements to non-technical audiences, both written and verbal
- Performing peer reviews for other data engineers' work
Essential Qualifications
To be successful in this role, you will need to have the following essential qualifications:
- 3+ years of experience engineering and operationalizing data pipelines with large and complex datasets
- 2+ years of experience with Informatica PowerCenter
- 2+ years of experience with Informatica IICS
- 2+ years of experience working with Cloud technologies, including ADLS, Azure Databricks, Spark, Azure Synapse, Cosmos DB, and other big data technologies
- 2+ years of experience with Data Modeling, ETL, and Data Warehousing
- 2+ years of experience implementing data integration strategies, including event/message-based integration (Kafka, Azure Event Hub), ETL
- 2+ years of experience with Git/Azure DevOps
- Extensive experience working with various data sources, including SQL, SQL Server database, flat files (CSV, delimited), Web API, XML
- Advanced SQL skills, with an understanding of relational databases, business data, and the ability to write complex SQL queries against various data sources
- Strong expertise in database storage standards, including Data Lake, Relational Databases, NoSQL, Graph, and Data Warehousing
- Able to work in a fast-moving agile development environment
Preferred Qualifications
While not essential, the following qualifications are preferred:
- Microsoft Azure/comparable certifications
- Experience delivering data solutions via agile software development methodologies
- Experience with PowerShell, Python, or similar scripting language
- Experience with UC4 Job Scheduler
- Exposure to the retail industry
- Excellent verbal and written communication skills
- BA/BS in Computer Science, Engineering, or equivalent software/services experience
Skills and Competencies
To be successful in this role, you will need to possess the following skills and competencies:
- Strong technical skills, with the ability to design, build, and maintain complex data pipelines
- Excellent problem-solving skills, with the ability to analyze complex data issues and develop effective solutions
- Strong communication skills, with the ability to communicate technical requirements to non-technical audiences
- Ability to work in a fast-moving agile development environment, with a focus on delivering high-quality results
- Strong collaboration skills, with the ability to work effectively with cross-functional teams
Career Growth Opportunities and Learning Benefits
At Workwarp, we are committed to providing our employees with opportunities for career growth and development. As a Data Engineer, you will have the opportunity to work on complex and challenging projects, developing your technical skills and expertise. You will also have access to training and development programs, designed to help you achieve your career goals.
Work Environment and Company Culture
Our company culture is built on a foundation of innovation, collaboration, and excellence. We believe in fostering a work environment that is supportive, inclusive, and empowering, where our employees can thrive and grow. As a remote worker, you will be part of a distributed team, with opportunities to collaborate with colleagues from around the world.
Compensation, Perks, and Benefits
We offer a competitive salary, with a range of $75,000 to $110,000 for Level 1 and $100,000 to $135,000 for Level 2. In addition to your salary, you will also be eligible for a range of perks and benefits, including health insurance, retirement savings, and paid time off.
Conclusion
If you are a motivated and experienced Data Engineer, looking for a new challenge, we encourage you to apply for this exciting opportunity. With a competitive salary, opportunities for career growth and development, and a supportive and inclusive company culture, this is a fantastic chance to take your career to the next level. Please submit your application today, and join our team of talented professionals.
Apply now and take the first step towards an exciting and rewarding career as a Data Engineer with Workwarp!
Apply Now