Senior Data Engineer

Detalles de la oferta

Company Overview Lean Solutions Group is committed to enhancing business efficiency through innovative technology solutions. Our mission is to drive transformation by leveraging cutting-edge AI and machine learning techniques. We uphold a culture of continuous learning, collaboration, and customer-centricity, ensuring exceptional outcomes for our clients. Recognized for our expertise in deploying scalable solutions that seamlessly integrate with enterprise systems, we have established a strong foothold in the tech industry. With a global presence and a team of dedicated professionals, Lean Solutions Group is at the forefront of innovation, constantly pushing boundaries to meet the dynamic needs of businesses worldwide. What You Will Be Doing Architect and implement autonomous GPT-based systems for real-time workflow automation. Fine-tune and optimize large language models for specific automation tasks. Automate end-to-end processes managing unstructured data and decision logic. Develop and maintain data pipelines using AWS services like Glue and Lambda. Ensure data integrity and efficient processing using tools like Pandas and PySpark. Design scalable solutions for seamless integration with enterprise cloud systems such as EC2 and RDS. Implement monitoring systems for deployed models and incorporate feedback mechanisms. Collaborate with cross-functional teams to gather requirements and deliver solutions aligned with business objectives. Stay informed on industry trends in AI and machine learning, integrating innovations into current systems. Required Skills & Experience Bachelor's or Master's degree in Computer Science, Machine Learning, Data Engineering, or a related field. 5+ years of experience in data engineering and machine learning, particularly with NLP and process automation. Advanced proficiency in Python, including experience with data analysis using pandas and machine learning frameworks like PyTorch and TensorFlow. Intermediate experience with AWS services, such as RDS, EC2, Glue, and Lambda, for managing data solutions and scaling models. Deep understanding of LLMs with experience in fine-tuning and applying NLP techniques. Experience with API development and integration. Strong knowledge of MLOps practices, including model deployment, versioning, and monitoring. Familiarity with data engineering tools and frameworks such as Pandas and PySpark for efficient data processing. Excellent problem-solving skills and ability to work with cross-functional teams. Intermediate knowledge of Docker and familiarity with microservices architecture and containerization technologies. Understanding of prompt engineering and reinforcement learning from human feedback (RLHF) to enhance GPT-based systems. Experience with reinforcement learning from human feedback (RLHF) techniques. Familiarity with microservices architecture. Proficiency in utilizing pandas and PySpark for data analysis. Experience with process automation tools and frameworks. Knowledge of prompt engineering to enhance GPT-based systems. Understanding of the ethical considerations and safety measures in autonomous systems. Intermediate experience with Docker for containerization. Advanced problem-solving skills with innovative solution approaches. Effective Communication: Ability to clearly articulate complex technical concepts to non-technical stakeholders, facilitating cross-functional collaboration. Problem-Solving: Strong analytical and innovative skills, essential for navigating and resolving complex challenges in data engineering and process automation. Collaboration: Demonstrated experience working with diverse teams to gather requirements and deliver data-driven solutions aligned with business objectives. Adaptability: Proactively stay informed about industry trends in AI and machine learning, and integrate innovative solutions into current systems to maintain a competitive edge. Leadership: Lead projects with a focus on optimizing performance and efficiency, fostering a culture of continuous improvement and learning. Why You Will Love Working with Us Join a powerful tech workforce and help us change the world through technology. Professional development opportunities with international customers. Collaborative work environment and career path and mentorship programs that will lead to new levels. Join Lean Tech and contribute to shaping the data landscape within a dynamic and growing organization. Your skills will be honed, and your contributions will play a vital role in our continued success. Lean Tech is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. #J-18808-Ljbffr


Salario Nominal: A convenir

Fuente: Whatjobs_Ppc

Requisitos

Senior Software Development Engineer

Location Details: Colombia - Remote At GoDaddy, the future of work looks different for each team. Some teams work in the office full-time, others have a hyb...


Colombia

Publicado a month ago

Analista De Compras

¡Sumate a nuesro equipo! Orientamos la búsqueda a profesionales con experiência en la posición, desarrollada en empresas de servicios. La persona selecciona...


Universidad Siglo 21 - Colombia

Publicado a month ago

Analista De Soporte Junior

Job Function: Software & Cloud Services Por qué SoftwareONE?: **ANALISTA DE SOPORTE JUNIOR** SoftwareOne es un proveedor líder mundial de software y solucio...


Softwareone - Colombia

Publicado a month ago

Data Engineer Associate

Accenture es una compañía global líder en servicios profesionales con una amplia gama de soluciones en estrategia y consultoría, tecnología y operaciones, ca...


Accenture - Colombia

Publicado a month ago

Built at: 2024-11-29T10:16:43.862Z