Topics In Demand
Notification
New

No notification found.

Understanding Machine Learning & Deep Learning
Understanding Machine Learning & Deep Learning

November 16, 2021

AI

422

0

Introduction

Machine Learning (ML) and Deep Learning (DL) are the two of the hottest buzzwords after Artificial Intelligence (AI) at the moment.

Our computers have evolved tremendously in the last couple of decades. By evolution, I don’t simply mean the advancements in processing power and data storage capacity, but also changes in the way machines function overall.

This has allowed computers to learn and perform increasingly complex tasks. A famous example of this — IBM’s Deep Blue computer successfully defeated reigning world Chess Champion Garry Kasparov in 1997!

But what is it that makes a computer efficient yet smart enough to perform such unbelievable and complex tasks?

Let’s find out!

 

What is Machine Learning?

All email providers today offer a special mail category known as ‘Spam’, but how does the email program figure out the criteria for this type of categorization?

The answer lies in Machine Learning.

The magic happens with a set of algorithms that are devised and implemented using a database of common phishing/irrelevant/misguiding/unwanted terms &/or phrases.

It could also be based on certain specific/typical patterns of email releases or rollouts. So when you receive a spam email, machine learning algorithms at the backend enable the system to identify and sort such messages automatically, placing it in the Spam folder and saving you the annoyance of doing it yourself while keeping you safe online.

I often receive emails that claim I have won the lottery. As tantalizing as that may be, I know for a fact such emails are bogus. Partly, because I avoid lotteries, and mostly because these emails contain a link to a malicious page.

Thankfully, my email provider is usually able to chauffeur such mails into the spam folder, keeping me and my computer safe. But, how does it do that?

Machine Learning (ML) algorithms scan such emails for words like “You have won the Lottery! Please click here to claim your prize.” They also verify whether the same mail has been sent to several users (thereby detecting a pattern). If these conditions are met, the rogue mail is relegated to the spam folder.

The awesome bit about ML isn’t that it can do this. It can also continuously evolve over time becoming more robust and data-driven.

Over time, it continuously parses data and learns from patterns thereby enabling better probabilistic prediction(s) correcting previous erroneous patterns in its repository. In English, this means it learns and gets better over time! Yay!

Typically, this requires the algorithm to learn from a huge amount of data (called a dataset) using it to analyse and improve predictions.

But, I cannot speak about ML without Artificial Intelligence (AI) which is a key factor driving ML. Why? ML algorithms are mostly derived using the fundamentals of AI.

There are several ML algorithms. Let me list out the most widely used ones:

1. Ensemble — Random Forest, Bagging and Boosting

2. Neural Networks — Perceptron, Back-Propagation

3. Regularization — LASSO and Ridge

4. Regression — Linear Regression, Logistic Regression, Least square methods

5. Clustering algorithms — k-Means Clustering, Expectation Maximization

6. Instance Based — k-Nearest Neighbour

7. Dimension Reduction — Principal Component Analysis, Linear Discriminant Analysis

8. Decision Tree — Classification and Regression Tree

9. Bayesian — Naive Bayes

What is Deep Learning?

The next step in the evolution of Machine Learning is Deep Learning or DL. DL is an extended part of the ML Family that enables more efficient ways to implement ML. However, I cannot speak about DL without talking about Artificial Neural Networks or ANN.

Chronology of evolution of Machine Learning

Machine Learning → Artificial Neural Networks → Deep Learning

An Artificial Neural Network is defined as :

“Artificial Neural Networks, are computational models based on the structure and functions of biological neural networks. It is like an artificial human nervous system for receiving, processing, and transmitting information in terms of Computer Science.”

An ANN consists of layered systems in which each layer has several building blocks known as Neurons which perform specific computation task(s). The idea is to mimic the biological nervous system.

Broadly, these layers are divided into 3 — Input Layer, Hidden Layer and Output Layer.

Deep Learning automates the task of predictions i.e. it helps design a model through which we can pass our dataset.

Why is this useful?

It is useful because in return it automatically computes all features/patterns significant for analysis and predictions. I think of it as a digital Sherlock Holmes, able to look at and identify patterns to discern a result.

The 5 most commonly used DL models:

1. Generative Adversarial Networks

2. Convolutional Neural Networks

3. Recurrent Neural Networks

4. Auto Encoders

5. Recurrent Neural Network

The DL methods deep learning engineers must be aware of:

1. Back Propagation

2. Learning Rate Decay curve

3. Max-Pooling

4. Dropouts

5. Stochastic Gradient Descent

6. Batch Normalization

7. Long Short-Term Memory

Conclusion

Machine Learning came into existence to develop smart systems and Deep Learning (along with ANN) took it to a different level altogether. While Machine Learning was just the beginning, Deep Learning has enhanced it to the point where we have humanoids and self-driven cars which were fictional just a few years ago!

I hope this blog helped you get some clarity on deep learning and machine learning. Always remain hungry for deep insights and be open to research!

Thank you for reading!


That the contents of third-party articles/blogs published here on the website, and the interpretation of all information in the article/blogs such as data, maps, numbers, opinions etc. displayed in the article/blogs and views or the opinions expressed within the content are solely of the author's; and do not reflect the opinions and beliefs of NASSCOM or its affiliates in any manner. NASSCOM does not take any liability w.r.t. content in any manner and will not be liable in any manner whatsoever for any kind of liability arising out of any act, error or omission. The contents of third-party article/blogs published, are provided solely as convenience; and the presence of these articles/blogs should not, under any circumstances, be considered as an endorsement of the contents by NASSCOM in any manner; and if you chose to access these articles/blogs , you do so at your own risk.


DLT Labs™ is a global leader in the development and delivery of enterprise blockchain technologies and solutions, as well as a pioneer in the creation and implementation of standards for application development. With a deep track record in innovation and one of the world's largest pools of highly experienced blockchain experts, DLT Labs™ enables the transformation and innovation of complex multi-stakeholder processes.

© Copyright nasscom. All Rights Reserved.