migration of data to GCP, building out the GCP BigQuery warehouse (and moving data from Redshift into it), sunsetting legacy ETL (Datastage) and replacing with various new data ingestion solutions.
- Experience in SnapLogic is strongly preferred; they have found this to be more amenable to upskilling.
- Needs experience in Airflow or Cloud Composer orchestration, development of new DAGs from scratch.
- Development of data ingestion and ETL pipelines from scratch. Using SnapLogic primarily for data pipelines and integrations, but also Python, SQL, Dataflow, Spark.
- Needs experience in data warehousing, Google BigQuery.
- Not responsible for building out visualizations; another team handles
- Will be supporting data modeling, but not owning. Should have some experience in data modeling, data warehousing fundamentals.
- Understanding of analytics as a whole, how data moves from source, warehouse, semantic or reporting layer, models, and reporting/BI, but their hands-on focus will be around building data pipelines and orchestration.
- Proactive communicators, inquisitive people, problem-solvers, unafraid to make suggestions, ask questions. “Order taker” and “heads down” types of Engineers will not be a culture fit for the team.
- They have a list of other technologies in their environment in smaller amounts/more dispersed–any would be a “nice to have”: i.e. Kafka, Java, Apache Beam, Alteryx, etc.
Required Skills : GCP experience
building data pipelines (ETL) from scratch
building data workflows
Python
SQL
Basic Qualification :
Additional Skills :
contract to hire
remote
Background Check : Yes
Drug Screen : No
Notes :
Selling points for candidate :contract to hire
remote
Project Verification Info :The information provided below is for Apex Systems AV use only and is not to be distributed publicly, or to any third party. Any distribution of the below information will result in corrective action from Apex Systems Vendor Management.
MSA: Blanket Approval Received
Client Letter: Will Provide
Exclusive to Apex :No
Face to face interview required :No
Candidate must be local :No
Candidate must be authorized to work without sponsorship :Yes
Interview times set :Yes
Type of project :
Master Job Title :
Branch Code :