Data Engineer 3
South Portland, ME 
Share
Posted 18 days ago
Job Description

WEX Inc. seeks a Data Engineer 3 in Portland, Maine (telecommuting permitted provided the Data Engineer 3 works at least two (2) days per week at the WEX office in Portland, Maine) to design, build, and oversee the deployment and operation of technology architecture, solutions, and software applications to capture, manage, store, and utilize structured and unstructured data from internal and external solutions in support of WEX's enterprise data and analytics capabilities. Duties include establishing and building processes and structures based on business and technical requirements to channel data from multiple inputs; creating optimized data pipelines using Python and data ingestion tools; routing appropriately and storing using any combination of distributed (cloud) structures, local databases, and other applicable storage forms as required; developing technical tools and programming that leverage artificial intelligence, machine learning, and big-data techniques to cleanse, organize, and transform data and to maintain, defend, and update data structures and integrity on an automated basis; creating and establishing design standards and assurance processes for software, software systems, and software application development to ensure compatibility and operability of data connections, flows, and storage requirements; reviewing internal and external business and product requirements for data operations and activity; and suggesting changes and upgrades to systems and storage to accommodate ongoing needs.

The minimum requirements for the position are a Bachelor's degree in Computer Science, Information Technology, Management Information Systems, or a related field and 3 years of experience or, alternatively, a Master's degree in Computer Science, Information Technology, Management Information Systems, or a related field and 1 year of experience; and the following proficiencies/skills: Python; Docker; Airflow; relational databases (RDMS); the following data ingestion tool(s): Qlik Replicate, Fivetran, or Informatica; the following AWS services: Elastic Computer Cloud (EC2), Virtual Private Cloud (VPC), Elastic Map Reduce (EMR), S3, IAM, Secrets Manager, and AWS CLI; Jenkins; Github; PySpark/Apache Spark; managed cluster platforms such as EMR; relational design principles; writing complex SQL queries; and experience with Jira, Agile Framework, and SAFe to deliver business results. Applicants may apply online at wexinc.com or e-mail resumes to applications@wexinc.com.

This position is eligible for the Employee Referral Program.

#LI-DNI


Equal Opportunity Employer/Vets/Disability

 

Job Summary
Company
Start Date
As soon as possible
Employment Term and Type
Regular, Full Time
Required Education
Bachelor's Degree
Required Experience
3+ years
Email this Job to Yourself or a Friend
Indicates required fields