Develop Freedom - Blog by Shubham Chaudhary
Humanity has always been shaped by the tools we create . From fire and the wheel to agriculture and steam engines, each technological leap has redefined what it means to be human. These advancements didn’t just make life easier; they fundamentally reshaped societies, economies, and power structures. As we enter the Intelligence Age , where artificial intelligence becomes an omnipresent resource ,…
📚 Rating 4.5 ⭐ / 5 🌟 Why We Sleep: Unlocking the Power of Sleep and Dreams by Matthew Walker My goodreads rating: 5 of 5 stars View all my reviews Review I started reading this book last year. I read the first three chapters and that gave me a good enough idea that I stopped reading the book and started giving myself full 8 hour uninterrupted sleeping time. Now with a whole year of experiencing…
A quarter of the global energy-related greenhouse gas emissions are from transit vehicles. With global carbon emissions on the rise, electric cars are going to be a crucial part of the future. Self-Driving cars are going to be more efficient and spend less time/fuel in traffic. While reading Bill Gate’s new book - ‘How to Avoid a Climate Disaster: The Solutions We Have and the Breakthroughs We…
Introduction At Zomato , we manage more than half a billion images, which are integral to various aspects of our platform. Every day, we process close to 100,000 new images, contributing to petabytes of data, with a daily influx of approximately 500 GB of fresh visual content. In this blog, we delve into how we built a neural network-based machine learning model to classify these images into…
At Zomato , we handle a vast number of images, with close to a hundred thousand new images daily. Often, we need to download, process, and then pass these images to our models. The traditional workflow involves fetching an image from a URL, saving it to a file, and then passing that file path for further processing. Traditional Workflow import logging import os import tempfile import cv2 import…
This July I got the opportunity to be a part of the biggest gathering of KDE developers - Akademy 2018 . The akademy conference gathers hundereds of KDE developers together for almost an entire week. It was held at TU Wien (Techincal University of Vienna) in the beautiful city Vienna , Austria from Saturday 11th to Friday 17th August 2018. The akademy conference as usual has 2 days of talks by KDE…
Classifying data is a common task in machine learning. Suppose some given data points each belong to one of two classes, and the goal is to decide which class a new data point will be in. In the case of support vector machines, a data point is viewed as a p-dimensional vector (a list of p numbers), and we want to know whether we can separate such points with a (p-1)-dimensional hyperplane. This is…
This is a summary for the research paper End-to-End Interpretation of the French Street Name Signs Dataset . This is a model that takes the multiple shots of street view signs as input and outputs the name in the format that will be directly shown in google maps. A full end to end model. This includes reading image, parsing text, converting text for google maps standard and combining text from…
Extract Transform Load (ETL) ETL process is to fetch data from different types of systems, structure it and save it into the destination database. Batch In the case of a batch job, the query will be run on the data saved at source-path and the transformed data will be saved at the destination dest-path . Streaming In the case of a streaming job, the query will run on the data continuously from…
When working in multi node environment like Spark/Hadoop clusters, docker diminishes the barrier to entry. By barrier to entry, I mean the need to have a constantly running EMR cluster, when you are still in development phase. With Docker, you can quickly setup a 4-5 node cluster on a single machine and start coding your spark job. You can understand what Docker is and why you would use Docker on…