Senior Data Engineer

Role: Senior Data Engineer

Location: Remote (Must be within Brazil)

Duration: 1 Year

Job Description

Provide data engineering consulting services to support the Trading Data & Analytics (TD&A) shared data capabilities. The Contractor will work with Buyer teams to design, build, enhance, operate, and support reusable data products, data pipelines, integrations, and platform capabilities that enable business solutions across multiple TD&A commodities and programs.

The Contractor will collaborate with Buyer product owners, architects, lead developers, data engineers, and delivery teams to deliver scalable and reliable data solutions while promoting engineering best practices, operational excellence, and technical documentation. The goal is to build and support reusable governed data products, data-scoped technologies, and ingestion pipelines for ETRMs and internal systems.

Required Skills

· Mandatory: DBT, Snowflake

· Good to Have: Power BI, data orchestration, workflow automation, scheduling, and dependency management across enterprise data products and services.

---

Details of the Work

· Design, develop, and maintain reusable data pipelines, shared datasets, and cross-commodity data capabilities supporting the TD&A ecosystem.

· Build and support data ingestion, transformation, integration, and delivery solutions across cloud-based platforms and enterprise data services.

· Implement data engineering solutions utilizing approved Buyer technologies: DBT, Snowflake, Confluent Cloud, Fivetran, NiFi, Power BI, data orchestration, workflow automation, scheduling, and dependency management.

· Develop and maintain data quality controls, monitoring capabilities, Datadog technology, validation processes, and operational procedures to ensure data reliability and accuracy.

· Collaborate with Buyer teams to design scalable, secure, and maintainable data architecture patterns consistent with established standards and governance requirements.

· Participate in technical design discussions, code reviews, peer reviews, and engineering best-practice initiatives.

· Produce and maintain technical documentation and knowledge-sharing materials as required.

Operational Support

The Contractor will also provide operational support including:

· Monitoring and supporting production data services, pipelines, integrations, and platform capabilities.

· Implementing and maintaining observability, telemetry, monitoring, and alerting solutions utilizing approved Buyer tooling.

· Troubleshooting data-processing failures, integration issues, platform defects, and operational incidents.

· Participating in incident triage, root-cause analysis, service restoration activities, and continuous improvement initiatives.

· Supporting platform readiness, data-service reliability, cost optimization, technical debt reduction, and operational excellence objectives.

· Working closely with development, architecture, infrastructure, and business teams to ensure successful delivery of shared data capabilities.

Deliverables

The Contractor will provide data engineering capacity. Deliverables will be prioritized and agreed mutually by Buyer and Contractor team members on an ongoing basis. Services delivered may include:

· Develop and manage Global Trading data products.

· Data Product platform configuration and optimization.

· Manage Snowflake structure and security.

· Implement data ingestion and provisioning.

· DevOps, release management, and engineering standards.

· Observability and production support.

Working Practices & Ownership

The Contractor will follow Agile delivery practices and work collaboratively with Buyer stakeholders during sprint planning, backlog refinement, solution design, development, testing, deployment, and production support activities.

Note: The Contractor's responsibilities are limited to the delivery and support of Global Trading Data Products. Ownership of commodity-specific business processes, business logic, architecture governance decisions, and Buyer-managed platform operations shall remain with the appropriate Buyer-designated teams. Contractor resources will support and enable these functions but will not assume ownership of them.