Deep Learning Researcher - External Audit Specialist

  • April 02, 2024
  • Programming & Tech
  • Freelance
  • Remote
  • 1200 to 2000 USD
Deep Learning
Deepspeed
Natural Language Processing (NLP)
Pytorch
Ray
English intermediate

Job Description: We are seeking an experienced Deep Learning Researcher to perform an external audit of training parameters for our Models. The primary objective of this role is to provide an expert evaluation of our training setup to ensure optimal resource utilization and prevent unnecessary wastage during training rounds, considering the significant computational resources involved (GPU/h) and the scale of our cluster. Responsibilities: Conduct a comprehensive audit of training parameters used in the project, focusing on resource efficiency, model performance, and training effectiveness. Evaluate the configuration and utilization of frameworks such as Ray, PyTorch, and Deepspeed in the training pipeline. Provide insights and recommendations for optimizing training processes, including parameter tuning, distributed training strategies, and resource allocation. Collaborate closely with our internal team to understand project requirements and integrate audit findings into the training pipeline. Communicate audit results and recommendations effectively to stakeholders, including project managers, engineers, and data scientists. Requirements: Extensive experience in deep learning research, with a strong focus on training large-scale models. Proficiency in frameworks such as Ray, PyTorch, and Deepspeed, with a demonstrated track record of implementing and optimizing training pipelines. Hands-on experience with training rounds involving models with approximately 70 billion parameters or similar scale. Solid understanding of distributed computing concepts and experience with GPU-accelerated training. Excellent analytical and problem-solving skills, with the ability to identify inefficiencies and propose effective solutions. Strong communication skills, both written and verbal, with the ability to convey technical concepts to non-technical stakeholders. Prior experience in conducting audits or performance evaluations of deep learning training setups is preferred. Estimated Hours: Initial audit estimated at approximately 10 hours, with potential for adjustments based on findings and recommendations.

Other related jobs

How to apply

1. Complete your personal data

Fill in the boxes with your professional data.

2. Talk about your skills

Verify your skills through answers you record to questions

3. Upload your resume

Sync your profile from your CV or LinkedIn

4. Complete your application

Specify your salary in US dollars, when you can start, and why you're the best fit.

About Free the Freela

With a mission to propel the best Latin American talent to new frontiers. We stand out as an innovative startup that has redefined the way professionals in Latin America connect with job opportunities around the world.

60x
Faster to hire talents than going alone
+70%
Saved on rectruitment and retention cost
+4
Average years of working experience

Ready to apply?

find amazing remote job opportunities in LATAM