Associate Engineer – Data

Job title:

Affiliate Engineer – Information

Firm

ZS Associates

Job description

Job Description:ZS is a spot the place ardour adjustments lives. As a administration consulting and expertise agency targeted on reworking international healthcare and past, our most respected asset is our individuals. Right here you’ll work side-by-side with a robust collective of thinkers and specialists shaping options from begin to end. At ZS, we consider that making an affect calls for a distinct strategy; and that’s why right here your concepts elevate actions, and right here you’ll have the liberty to outline your individual path and pursue cutting-edge work. We accomplice collaboratively with our shoppers to develop merchandise that create worth and ship firm outcomes throughout crucial areas of their enterprise together with portfolio technique, buyer insights, analysis and growth, operational and expertise transformation, advertising and marketing technique and lots of extra. When you dare to assume in another way, be a part of us, and discover a path the place your ardour can change lives.Our most respected asset is our individualsAt ZS we honor the seen and invisible parts of our identities, private experiences and perception programs—those that comprise us as people, form who we’re and make us distinctive. We consider your private pursuits, identities, and want to study are a part of your success right here. about our variety, fairness, and inclusion efforts and the networks ZS helps to help our ZSers in cultivating neighborhood areas, acquiring the sources they should thrive, and sharing the messages they’re obsessed with.OverviewA Information Engineer is a crucial member of this group, specializing in designing, constructing, and sustaining programs and infrastructure that allow environment friendly processing, assortment, storage, and evaluation of huge volumes of information. This position collaborates carefully with enterprise analysts, knowledge scientists, and different stakeholders to make sure clear, correct, and available knowledge for knowledgeable decision-making and operational optimization.TasksInformation Structure and Modeling:

• Design and construct strong knowledge fashions that align with enterprise necessities.
• Create scalable knowledge architectures that accommodate development and evolving knowledge wants.

Information Pipeline Improvement:

• Develop and keep knowledge pipelines that facilitate seamless knowledge movement from varied sources to knowledge warehouses or storage programs.
• Optimize ETL (Extract, Remodel, Load) processes for effectivity and reliability.

Information Storage Options:

• Implement and handle knowledge storage options, together with relational databases (e.g., SQL, PostgreSQL) and non-relational databases (e.g., MongoDB, Cassandra).
• Arrange and keep knowledge lakes for large-scale knowledge storage.

Information High quality and Consistency:

• Debug code points / bugs utilizing stack traces, logs, monitoring instruments, and different sources.
• Guarantee knowledge consistency and accuracy by validation and cleaning strategies.
• Collaborate with cross-functional groups to handle data-related points.
• Design and implement technical options leveraging finest practices for expertise stack getting used.
• Write production-ready code that’s simply testable, understood by different builders and accounts for edge circumstances and errors.
• Guarantee highest high quality of deliverables by following structure/design tips, coding finest practices, periodic design/code evaluations and performing code/script evaluations of senior engineers within the group.
• Write unit checks in addition to increased degree checks to deal with anticipated edge circumstances and errors gracefully, in addition to completely satisfied paths.

Topic Matter Experience:

• Keep up to date on business developments and finest practices in knowledge engineering.
• Present steering on knowledge engineering instruments, applied sciences, and methodologies.
• Implement complicated options with restricted steering from the engineering lead. For instance: service or application-wide change.
• Analysis & consider the most recent applied sciences by speedy studying, conducting proof-of-concepts and creating prototype options.

Consumer Challenge Options:

• Work carefully with shoppers to grasp their knowledge engineering necessities.
• Design and implement best-in-class knowledge engineering options tailor-made to shopper initiatives.
• Break down giant options into estimable duties, leads estimation and may align with shoppers.

Collaboration:

• Collaborate with different technical groups to combine knowledge options seamlessly.
• Take part in scrum calls and agile ceremonies, and successfully talk work progress, points and dependencies.
• Collaborate with shopper going through groups to grasp answer context and contribute in technical requirement gathering and evaluation.
• Work with technical architects on the group to validate design and implementation strategy.

Training / Expertise / ExpertiseTraining: A related bachelors or higher-education diploma in Pc Science, Information Science, or associated fields.Technical Expertise:

• Proficiency in programming languages resembling Python, Java, or Scala.
• Expertise with huge knowledge applied sciences (e.g., Hadoop, Spark, Kafka).
• Familiarity with cloud-based programs (e.g., AWS, Azure).
• Information of information integration and ETL instruments (e.g., Talend, Informatica, Apache NiFi).
• Good Experience on Information Ingestion, Information Storage, Orchestration, Information Material, Error logging and Auditing, Job Monitoring, knowledge administration on Cloud ideally Azure or AWS.
• Good data of Azure Databricks and/or AWS EMR
• Good understanding of Information warehousing ideas and finest practices
• Sturdy in at the least one of many Programming languages – Python or Java, Scala, and so forth. and Programming fundamentals – Information Constructions.
• Good to have

• Azure Certification on Information Engineering
• AWS certification on Information Engineering
• Information of information modeling
• Journey to different international workplaces as wanted to work with shopper or different inner challenge groups.
• Means to journey to different workplaces or shopper places as wanted.
• Sturdy communication abilities

Expertise:

• 1 to three+ years of expertise in Information Engineering position.
• Deep data or expertise of working with Massive knowledge – Hive, Spark, Hadoop, queueing system like Apache Kafka/Rabbit MQ/AWS Kinesis
• Deep data or arms on expertise in constructing metadata pushed, reusable design patterns for knowledge pipeline, orchestration, ingestion patterns (batch, actual time);
• Deep data or expertise in designing and implementation of answer on distributed computing and cloud providers platform (however not restricted to) – AWS, Azure, GCP;
• Deep data or arms on expertise constructing CI/CD pipelines and consciousness of practices for software monitoring.

Perks & Advantages:ZS gives a complete whole rewards bundle together with well being and well-being, monetary planning, annual go away, private development {and professional} growth. Our strong abilities growth applications, a number of profession development choices and inner mobility paths and collaborative tradition empowers you to thrive as a person and international group member.We’re dedicated to giving our workers a versatile and linked approach of working. A versatile and linked ZS permits us to mix work at home and on-site presence at shoppers/ZS workplaces for almost all of our week. The magic of ZS tradition and innovation thrives in each deliberate and spontaneous face-to-face connections.Contemplating making use of?At ZS, we’re constructing a various and inclusive firm the place individuals carry their passions to encourage life-changing affect in international healthcare and past. We’re most desirous about discovering the perfect candidate for the job and acknowledge the worth that candidates with all backgrounds, together with non-traditional ones, carry. In case you are desirous about becoming a member of us, we encourage you to use even in the event you do not meet 100% of the necessities listed above.ZS is an equal alternative employer and is dedicated to offering equal employment and development alternatives with out regard to any class protected by relevant legislation.To Full Your Utility:Candidates should possess work authorization for his or her meant nation of employment. An on-line software, together with a full set of transcripts (official or unofficial), is required to be thought-about.NO AGENCY CALLS, PLEASE.

Anticipated wage

Location

Toronto, ON

Job date

Wed, 27 Mar 2024 00:49:32 GMT

To assist us observe our recruitment effort, please point out in your e-mail/cowl letter the place (globalvacancies.org) you noticed this job posting.