[Job - 29253] Senior Data Developer (AWS), Brazil

We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions.
With over 8,000 CI&Ters around the world, we’ve built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality.

We are seeking a talented and motivated Data Developer to join our team. This role is pivotal in constructing scalable artificial intelligence solutions across various domains, including Commercial, Marketing, IT, and future areas of the company. The Data Developer will play a critical role in evolving isolated AI use cases into a unified ecosystem capable of integrating advanced AI capabilities.
The successful candidate will contribute to building the technical foundation of our platform, enabling independent evolution, integration with multiple data sources, and accelerating new AI capabilities within the company. This position demands a blend of technical expertise, strategic thinking, and a hands-on approach to data development.

Responsibilities:

• Data Pipeline Development: Develop jobs in AWS Glue/Spark or Python (Pandas/Lambdas) for transforming raw data into curated datasets.

• Data Storage Structuring: Structure data in Amazon S3 (Data Lake) and integrate it with Vector Databases or Redshift to support advanced analytics.

• Data Processing: Handle both structured and unstructured data, ensuring it is processed into optimized formats (e.g., Parquet) for efficient querying and analysis.

• Orchestration Configuration: Configure workflows using AWS Step Functions or Managed Workflows for Apache Airflow (MWAA) to automate data processing tasks.

• Collaboration with Cross-functional Teams: Work closely with data scientists, engineers, and business stakeholders to understand data needs and deliver high-quality solutions.

• Performance Monitoring: Monitor and analyze data pipeline performance, ensuring reliability and efficiency in data processing workflows.

• Governance and Scalability: Implement data governance practices and scalable architectures to support corporate data initiatives.

• AI Integration: Support the integration of AI capabilities into data workflows, enhancing the overall efficiency and effectiveness of our solutions.

Requirements:

• Advanced English proficiency (minimum) for interaction with global teams and documentation.

• Strong experience with AWS ecosystem, particularly with S3 as the primary data source.

• Proficiency in data processing frameworks such as AWS Glue, Spark, or Python (Pandas/Lambdas).

• Experience with Databricks and Databricks Connector, including API integrations for data processing and structuring.

• Expertise in handling structured and unstructured data, with knowledge of Vector Databases (e.g., Qdrant) for AI applications.

• Proven ability to work in a hands-on capacity, transforming diverse files into processable datasets.

Nice to Have:

• Familiarity with AI frameworks and methodologies.

• Experience with data orchestration tools like Apache Airflow.

• Knowledge of data governance and compliance standards.

• Understanding of performance optimization techniques for data pipelines.

#LI-JP3

Our benefits:

-Health and dental insurance
-Meal and food allowance
-Childcare assistance
-Extended paternity leave
-Partnership with gyms and health and wellness professionals via Wellhub (Gympass) TotalPass;
-Profit Sharing and Results Participation (PLR);
-Life insurance
-Continuous learning platform (CI&T University);
-Discount club
-Free online platform dedicated to physical, mental, and overall well-being
-Pregnancy and responsible parenting course
-Partnerships with online learning platforms
-Language learning platform
And many more!

More details about our benefits here: https://ciandt.com/br/pt-br/carreiras

At CI&T, inclusion starts at the first contact. If you are a person with a disability, it is important to present your assessment during the selection process. See which data needs to be included in the report by clicking here.This way, we can ensure the support and accommodations that you deserve. If you do not yet have the assessment, don't worry: we can support you in obtaining it.

We have a dedicated Health and Well-being team, inclusion specialists, and affinity groups who will be with you at every stage. Count on us to make this journey side by side.