Hire the Top 2% of
Remote Spark Dataframe Developers
in Brazil

hugo A.

Vetted Spark dataframe developer in Brazil (UTC-3)

**Deep Learning Architect (L5) | AWS Generative AI Innovation Center** _São Paulo, Brazil_ With 5+ years experience in AI/ML, I am currently a Deep Learning Architect at AWS Generative AI Innovation Center, blending my expertise in Generative AI science with advanced architectural design to deliver robust, scalable solutions. In my role, which merges the responsibilities of a Data Scientist and a Solutions Architect, I lead customer engagements from proof-of-concept to production-grade systems, ensuring they are secure, fault-tolerant, and optimized for enterprise performance. As a tech lead, I maintain a hands-on approach—contributing to model development, optimization, and deployment—while collaborating with diverse teams to design solutions that drive innovation and disrupt industries. I am seeking long-term opportunities where I can leverage my dual expertise to develop cutting-edge Generative AI solutions and help companies revolutionize their business verticals through transformative technology. ### **Technical Skills** **Artificial Intelligence & Machine Learning** * Expertise in Large Language Models (LLMs), Natural Language Processing (NLP), Computer Vision, Neural Networks, Transformers * Hands-on experience with frameworks: PyTorch, TensorFlow, Scikit-learn **Cloud Computing & DevOps** * 4 AWS Certified (Soultions Architect, Cloud Developer, Machine Learning Specialty, Data Analytics Specialty), Docker, Kubernetes, CircleCI, Elastic Beanstalk, Apache Airflow **Programming & Software Development** * Proficient in Python, R, and SQL * Experienced in building and consuming RESTful APIs and GraphQL **Data Engineering & Big Data** * Skilled in Apache Spark, NoSQL databases (MongoDB, DynamoDB, Elasticsearch) * Experienced in building data pipelines, ETL processes, and optimizing data workflows **Data Analytics & Visualization** * Proficient in Power BI * Proficient Plotly, Bokeh, Matplotlib and Seaborn * Advanced statistical modeling using using R and statsmodels **Soft Skills** * Strong problem-solving ability, Agile/Scrum methodology, proven team leadership, and commitment to continuous learning **Languages** * Portuguese (Native), English (Fluent), French (Fluent), Spanish (Advanced), German (Advanced)

Igor T.

Vetted Spark dataframe developer in Brazil (UTC-3)

I am a Software Engineer who has been working with data since 2017. In my career, I have worked on different solutions, such as planning and building a Data Lake on AWS using Delta Lake to store 3D Printer sensor information, and developing a data product to device the optimal energy allocation in Minning facilities reducing the cost of R$1,000,000.00 per year using R. My primary programming language is Python, and I have expertise working with data engineering tools in the AWS environment, like Spark, Airflow, Redshift, EMR, Kinesis, and Lambda. My greatest passion is working with projects that can challenge me and make me a better developer

Aniceto J.

Vetted Spark dataframe developer in Brazil (UTC-3)

I am a data engineer and Backend Developer with more than 15 years of experience in software development and systems analysis. I have a bachelor's degree in Information System, a master's degree in Computer Science and a PhD in Mechanical Engineering with an emphasis on artificial intelligence. In the first quarter of 2020, finalize a data lake project on AWS to receive data from the industrial sector. I work with technologies such as AWS, Docker, Kubernetes, Java, AngularJS, Angular 8, Python, NodeJS, SpringBoot, PostgreSQL, SQL Server, MYSQL. I have the ability to learn and integrate different technologies.

Tiago F.

Vetted Spark dataframe developer in Brazil (UTC-3)

Results-driven data engineer with 6 years of experience in designing and implementing data solutions. Proficient in leveraging PySpark, Python, Hadoop, PostgreSQL, and AWS to develop scalable and efficient data pipelines, ETL processes, and data warehousing solutions. Demonstrated expertise in optimizing data workflows, ensuring data quality and integrity, and driving data-driven decision-making. Adept at collaborating with cross-functional teams to deliver innovative solutions that meet business requirements. Strong problem-solving and analytical skills combined with a commitment to continuous learning and staying up-to-date with emerging technologies in the data engineering space.

Caio S.

Vetted Spark dataframe developer in Brazil (UTC-3)

As a data engineer I'm driven by solving problems with the most clean and efficient solution, I am passionate about working with data in many different levels. With experience from collecting data all the way to creating dashboards and drawing insights I can reliably take in consideration the wider scope of any process do design and implement data driven solutions.

Matheus Z.

Vetted Spark dataframe developer in Brazil (UTC-3)

Hello, my name is Matheus and I am a full stack developer with experience in the finance industry. I have more than 5 years of experience in developing and maintaining backend systems for financial institutions using Node.js and TypeScript. I have experience in building and deploying high-performance and scalable servers utilizing modern Javascript language features. I am familiar with popular Node.js frameworks such as Express.js, Nest.js and well-versed in Object-oriented concepts and design patterns that help me to structure and maintain my codebase. Also, I have experience with database technologies like MySQL, MongoDB and well-versed in version control systems like git.

Felippe M.

Vetted Spark dataframe developer in Brazil (UTC-3)

I'm an Engineer, with a background in Artificial Intelligence, and I've always sought to use technology to solve problems. In my Master's, my study focused on Artificial Neural Networks, and I've published scientific articles and produced a dissertation on the subject. In the last four years, I've dedicated myself to studying Data Science (Python, ML, SQL, Spark). I'm responsible and a team worker. During my career, I've taken on several managerial roles, having even led remote teams. I know how to work with other people and try to treat everyone with respect and courtesy. I'm always open to hearing suggestions, criticisms, and other perspectives. I have just finished the Data Science Bootcamp with the french school Le Wagon. It was an amazing experience and I was able to further consolidate my skills in Data Science: statistics and probability, SQL, Python (Pandas, Numpy, Sklearn, PyTorch, Tensorflow/Keras), NLP, MLOPs basics (Google Cloud). I am searching for new challenges and experiences, and I believe I can make valuable contributions.

Lawrence F.

Vetted Spark dataframe developer in Brazil (UTC-3)

I'm a Data architect, with past experiences in Business Intelligence and Data Engineering on leading companies, such as IBM, B2W, and Nestlé. I've being working for 5 years on Big Data projects, using multiple clouds (GCP, AWS, and Azure) and architectures (Data Warehouses/Lakes/Lakehouses, Modern Data Platforms, Data Mesh). Currently, I'm the leader of Debussy, an opinionated open-source data architecture and engineering framework that integrates Airflow, Spark, and dbt.

Igor U.

Vetted Spark dataframe developer in Brazil (UTC-3)

Sr Data Engineer | AWS Solutions Architect Certified | Spark Databricks developer Certified * 📷Sigma Software Group * 📷Federal University of Viçosa I'm Igor and I'm working in the IT area since 2015. I started my career being a software engineer, working on the backend, front end development, and DevOps, but at that time we already handled lots of data, but some datasets had become pretty much larger than we had used to see, so I discovered my real passion: the big data world. So I decided to jump into the data world where I'm until today. I'm a Data Engineer more focused on programming and infrastructure, so I have worked providing larger data engineering teams with some customized tools to help them during their data pipeline development. I have experience in providing and maintaining big data clusters, either on-premises or on the cloud, with some ready-to-use open-source (or customized) tools like Hadoop, Spark, Hive, Presto, Druid, Sqoop, NiFi, and others. Across all my work experience, I have done some user education 1:1s and training sessions to help our consumers on using our tooling efficiently. Also, sometimes I was allocated to some projects in order to help in data pipeline development using both real-time and batch approaches. One of my greatest achievements regarding this was designing and developing an automated framework for ETL development where business users can focus more on data pipeline development rather than what surrounds it. This project has been largely used and improved nowadays by the responsible team. I have also experience with ML in production or MLOps. I have worked as a technical lead in an MLOps squad helping my team on designing and development of a whole ML platform where users can develop, build, deploy and monitor their own ML models using some key concepts like model bias, input/output data drift (data quality and integrity) without any DevOps skills or extra knowledge

Gustavo S.

Vetted Spark dataframe developer in Brazil (UTC-3)

Throughout his career, Gustavo has established himself as a Full Stack Developer and Software Architect, distinguished by his expertise in engineering sophisticated software solutions, steering application development, and leading technology implementations across various sectors. His journey is a testament to his relentless pursuit of excellence in cloud-based applications and data engineering, underscored by his commitment to creating scalable, efficient solutions leveraging first-class and No/Low Code tech stacks. Gustavo's career is characterized by a unique blend of technical prowess and strategic insight, enabling him to simplify complex technical concepts for high-level executives and software engineers alike, thus translating intricate technicalities into strategic business insights. This skill has not only enhanced his ability to deliver impactful presentations but has also solidified his reputation as a trusted "CTO for Hire" within startup accelerators. In this capacity, Gustavo has adeptly coordinated technology strategies, navigated the complexities of managing competing priorities from diverse organizations, and tailored solutions that resonate with client needs with empathy and precision. A defining moment in Gustavo's career was the successful development and implementation of a No/Low Code proof of concept, leading to the execution of a significant project that surpassed scalability and efficiency benchmarks. This achievement highlighted his proficiency in No/Low Code platforms, a skill set he is eager to leverage in guiding enterprise customers to maximize their investments. The cornerstone of Gustavo's work is collaboration, having spent over four years working closely with native teams and managers, honing his understanding of cross-cultural and interdisciplinary team dynamics. His technical repertoire encompasses Python, JavaScript, React, Vue.js, Node.js, alongside expertise in cloud platforms like GCP and AWS, enriched by a solid foundation in data processing frameworks such as PySpark and Apache Kafka. As Gustavo looks towards the future, his ambition is to embrace the role of a Customer Engineer, where he can apply his technical expertise, strategic planning, and organizational skills to cultivate deep relationships with enterprise customers. With more than six years of experience in enterprise-level technical pre-sales and solution consulting, Gustavo is well-equipped to navigate the complexities of customer needs, crafting pathways to technological adoption and transformation that resonate across competitive landscapes.