ML Engineering and ML Ops – what’s the buzz about? | nasscom | The Official Community of Indian IT Industry

Terms of use

Terms of Use

The use of this site and the content contained therein is governed by the Terms of Use. When you use this site you acknowledge that you have read the Terms of Use and that you accept and will be bound by the terms hereof and such terms as may be modified from time to time.

All text, graphics, audio, design and other works on the site are the copyrighted works of nasscom unless otherwise indicated. All rights reserved.
Content on the site is for personal use only and may be downloaded provided the material is kept intact and there is no violation of the copyrights, trademarks, and other proprietary rights. Any alteration of the material or use of the material contained in the site for any other purpose is a violation of the copyright of nasscom and / or its affiliates or associates or of its third-party information providers. This material cannot be copied, reproduced, republished, uploaded, posted, transmitted or distributed in any way for non-personal use without obtaining the prior permission from nasscom.
The nasscom Members login is for the reference of only registered nasscom Member Companies.
nasscom reserves the right to modify the terms of use of any service without any liability. nasscom reserves the right to take all measures necessary to prevent access to any service or termination of service if the terms of use are not complied with or are contravened or there is any violation of copyright, trademark or other proprietary right.
From time to time nasscom may supplement these terms of use with additional terms pertaining to specific content (additional terms). Such additional terms are hereby incorporated by reference into these Terms of Use.

Disclaimer

The Company information provided on the nasscom web site is as per data collected by companies. nasscom is not liable on the authenticity of such data.
nasscom has exercised due diligence in checking the correctness and authenticity of the information contained in the site, but nasscom or any of its affiliates or associates or employees shall not be in any way responsible for any loss or damage that may arise to any person from any inadvertent error in the information contained in this site. The information from or through this site is provided "as is" and all warranties express or implied of any kind, regarding any matter pertaining to any service or channel, including without limitation the implied warranties of merchantability, fitness for a particular purpose, and non-infringement are disclaimed. nasscom and its affiliates and associates shall not be liable, at any time, for any failure of performance, error, omission, interruption, deletion, defect, delay in operation or transmission, computer virus, communications line failure, theft or destruction or unauthorised access to, alteration of, or use of information contained on the site. No representations, warranties or guarantees whatsoever are made as to the accuracy, adequacy, reliability, completeness, suitability or applicability of the information to a particular situation.
nasscom or its affiliates or associates or its employees do not provide any judgments or warranty in respect of the authenticity or correctness of the content of other services or sites to which links are provided. A link to another service or site is not an endorsement of any products or services on such site or the site.
The content provided is for information purposes alone and does not substitute for specific advice whether investment, legal, taxation or otherwise. nasscom disclaims all liability for damages caused by use of content on the site.
All responsibility and liability for any damages caused by downloading of any data is disclaimed.
nasscom reserves the right to modify, suspend / cancel, or discontinue any or all sections, or service at any time without notice.

For any grievances under the Information Technology Act 2000, please get in touch with Grievance Officer, Mr. Anirban Mandal at data-query@nasscom.in.

New

See all

No notification found.

ML Engineering and ML Ops – what’s the buzz about?

TargetinIndia

@TargetinIndia

November 24, 2021

Data Science & AI Community

1487

The term ‘ML Engineering’ has exploded in the past few years, touted as the ‘hottest job’ in Technology. However, the term ‘ML Engineering’ is nebulous, and is used in a variety of ways. Recently, it has become commonplace to throw in this term to make a job appear more attractive. This post will provide some clarifications and hopefully, help some of you understand what this term actually means and enable some of you to make decisions on developing your career in this domain.

Machine Learning (ML) is a branch of Artificial Intelligence involving algorithms to perform specific tasks/activities (like predictions or decisions) purely from data in an automated manner, i.e., without explicit human guidance on how to perform those tasks/activities. These algorithms are typically complex statistical algorithms involving very large data sets. So to make these algorithms successful in practice, we require fairly elaborate engineering. The engineering associated with ML is what we call "ML Engineering".

However, this is too abstract a definition as there are different forms of engineering associated with ML. When it comes to exploring or developing a career in "ML Engineering", it pays to understand this term by splitting "ML Engineering" into two buckets that require fairly different technical backgrounds, and the nature of the engineering work also tends to be fairly different. Hence, we categorize "ML Engineering" into the following two buckets:

Engineering for Development of ML Models: This is the engineering work required to train an ML model, experiment with different choices of models and hyper-parameters (known as "hyperparameter tuning"), experiment with different choices of features used to train the model (known as "feature engineering"), and invest in the software engineering for model efficiency, reusability, and readability.

This engineering work is typically highly entangled with the mathematical and statistical aspects of ML Model Development. So, it's impossible to do this type of engineering work without a depth of understanding of the mathematics of ML (for example, cross-entropy, gradient descent, embeddings, etc.).

Fortunately, there are several good books and videos (plus open-source code) to learn about this topic. This educational content is typically a joint education on the mathematics and engineering associated with the development of ML Models (because of how entangled mathematics and engineering are).

Engineering for Deployment of ML Models: This is the engineering work required to deploy and support ML model training pipelines and inference in production. Sometimes this area is named as "MLOps". Although we used the somewhat-narrow term "Deployment", there are many aspects here involving real-time performance. This includes caching for immediate inferencing, ensuring the right model version is used, the ability to debug production errors reliably and quickly, and collect and assess performance metrics for model-feedback.

Much of the engineering work involved here has strong resemblances to traditional deployment of software, which an engineering without a background in ML should be very familiar with. In fact, this is the reason this area is a much easier entry point into the world of ML for an engineer. We'd argue that one can do the "MLOps" job with only a surface-level understanding of ML, as long as one has got significant experience in the traditional engineering world of "DevOps".

So now we’d like to provide some reading/coding content to learn about the world of “MLOps”. We will provide the content in 3 layers, starting with a quick, introductory read and ending with an entire hands-on course that will train a traditional software engineer in the world of “MLOps”.

https://stackoverflow.blog/2020/10/12/how-to-put-machine-learning-models-into-production/ is a short blog post on deploying ML models in production (introductory content)
https://mlinproduction.com/deploying-machine-learning-models/ breaks up the world of “MLOps” into its different aspects and is a series of blog posts explaining the different aspects in some detail.
We all know that an engineer truly understands a subject only by “doing”. Hence, we recommend a wonderful course taught in the Computer Science department at Stanford (Disclaimer: We might be a bit biased here with the university choice): https://stanford-cs329s.github.io/index.html. The good news is that you don’t have to be a Stanford student to learn this material. All the lecture notes and slides are available openly. More importantly, this GitHub repo: https://github.com/mrdbourke/cs329s-ml-deployment-tutorial is the codebase that serves as the tutorial throughout this course. We want to emphasize that you can’t learn ML Ops by simply reading a textbook. You have to write code to actually deploy and test an ML model in order to truly grasp this subject. We hope you enjoy this coding experience!

We hope this article has provided some clarity on ML Engineering and ML Operations and how you can get started on this journey. There is a world of information and resources available no matter which career path you take – it’s about understanding how this could make a difference to your engineering career and deciding what’s right for you.

Authors


Anupama Joshi, Senior Director, Technology, Target	Ashwin Rao, Vice President, AI, Target

#AI #artificialintelligence #machinelearning #ML #MLOps #MLEngineering

Disclaimer

That the contents of third-party articles/blogs published here on the website, and the interpretation of all information in the article/blogs such as data, maps, numbers, opinions etc. displayed in the article/blogs and views or the opinions expressed within the content are solely of the author's; and do not reflect the opinions and beliefs of NASSCOM or its affiliates in any manner. NASSCOM does not take any liability w.r.t. content in any manner and will not be liable in any manner whatsoever for any kind of liability arising out of any act, error or omission. The contents of third-party article/blogs published, are provided solely as convenience; and the presence of these articles/blogs should not, under any circumstances, be considered as an endorsement of the contents by NASSCOM in any manner; and if you chose to access these articles/blogs , you do so at your own risk.

TargetinIndia

Key Trends in Gen AI Startups: Pivo...

Madhumay

Digital Transfo..

15 Nov 2024

Power of Machine Learning via Data ...

Snowflake

Machine Learnin..

15 Nov 2024