Leadership & Career Profile

Table of Contents

Profile

Executive summary

AI Observability Architect with 14+ years progressing from mainframes and Big Data through multi-cloud architecture and AIOps at IBM, enterprise search, MLOps/LLMOps, AI observability, and production operations.

  • Led engineering and delivery teams in global product and services environments, from early architecture through production operations.
  • Built platform capabilities that standardize how teams deploy, observe, evaluate, scale, and improve AI systems.
  • Combine hands-on technical judgment with team development, documentation, cross-functional alignment, and durable operating mechanisms.
  • Experienced across Banking & Finance, Food & Beverages, Education, and enterprise software.
  • Public work includes an IEEE paper on LLM fine-tuning, a pending patent, OpenTelemetry certification, conference talks, and open-source ecosystem stewardship.

Operating scope

Leadership focus

  • Enterprise AI platform strategy and operating models
  • Engineering team leadership, mentoring, and delivery systems
  • AI observability, evaluation, reliability, and sustainable operations
  • MLOps, LLMOps, AIOps, and production lifecycle governance
  • Architecture decisions across data, models, services, and platform boundaries
  • Cross-functional communication and technical writing
Technical foundation
CategorySkills
ML toolsGrafana, LogStash, Databricks, MLFlow, LangChain, LCEL, LangGraph, LangSmith, Kibana, W&B
Web FrameworksFlask, FastAPI, Django, ReactJS, Go Fiber, Gin
Programming LanguagesPython, SQL, Golang, Javascript, Typescript, Shell script, Batch script, VB Script, COBOL, C, C++, MATLAB
DatabasesMySQL, PostgreSQL, ClickHouse, AWS ElastiCache, MongoDB, Redis, Elasticsearch, AWS Open search, IBM DB2
CI/CD ToolsGit, GitHub, GitLab, Docker, Kubernetes, Jenkins, GitHub Actions, Cloudflare Pages, AWS Code Commit, AWS CodeBuild, AWS CodeDeploy, AWS CodePipeline
Documentation ToolsMarkdown, GitHub pages, Jekyll, Confluence, Jupyter Notebook, GitHub Wiki, Grammarly, Excalidraw, MS Visio, D2
Other ToolsKafka, Spark, Nifi, Airflow, Nginx, Envoy proxy, Postman

Career path

Experiences

2024 to present

Current

PepsiCo

AI Observability Architect

My public work and writing in this role center on AI observability, evaluation, production reliability, and the operating systems that help teams use AI responsibly at scale.

2021 to 2024

Freshworks

Lead MLOps/System Engineer

  • Designed an end-to-end LLM operations platform for existing production solutions.
  • Built lifecycle capabilities for model monitoring, logging, evaluation, versioning, usage, adoption, deployment, scaling, and retraining.
  • Standardized model-service creation and deployment across production regions and operating modes.
  • Fine-tuned and benchmarked open-source LLMs for custom use cases, improving the cost and latency profile.
  • Documented proposed and implemented changes so teams could extend the platform without relying on tribal knowledge.
  • Improved the throughput, latency, and operational reliability of production ML services.
  • Performance-tested ML applications against realistic production load and removed database and application bottlenecks.
  • Used incident analysis to turn recurring outages into permanent engineering improvements.

2018 to 2021

IBM

MCMP AIOps Platform Squad Leader

  • Worked across multi-cloud management architecture and its AIOps platform capabilities.
  • Led a cross-functional development and QA squad working on AIOps platform capabilities.
  • Implemented consumption-based pricing and tiered packaging for client use cases.
  • Designed and implemented multi-tenant architecture.
  • Architected end-to-end user authentication and authorization in the ELK stack.
  • Proposed transformation options for a unified real-time and batch ingestion and analytics framework.

2016 to 2018

Wipro

Technical Lead

  • Led an engineering and QA team developing an enterprise-grade cognitive search product.
  • Took the product from proof of concept through scalable customer deployments.
  • Improved query performance and search accuracy while supporting client demonstrations and production rollouts.
  • Converted natural-language queries to structured query languages for enterprise data search.
  • Applied NLP automation to extract useful entities from client-vendor conversations in a banking workflow.

2014 to 2016

Accenture

Application Development Analyst

  • Automated complex screen-entry workflows, reducing repetitive operational effort.
  • Analyzed high-severity production issues and built lasting fixes.
  • Worked in a global banking environment and developed domain knowledge in money transfer.
  • Broke down business and technical requirements into manageable delivery plans.
  • Conducted unit, sanity, and system-integration testing.

2012 to 2014

Tata Consultancy Services

Systems Engineer

  • Worked in a US brokerage environment and developed domain knowledge in mutual funds and stocks.
  • Used business and high-level design documents to connect business, technical, and functional requirements.
  • Helped the team plan enhancements and delegated work to junior associates.

Community work

Volunteering Experience

OpenStreetMap is a trademark of the OpenStreetMap Foundation. This site is not endorsed by or affiliated with the Foundation.

Academic foundation

Education

BITS Pilani2021 to 2023

M.Tech in Data Science and Engineering

Graduate study in data science and engineering.

Credentials

License and Certifications

Intellectual property

Patents

Research

Publications

Recognition

Honor and Awards

  • Social Impact Award (2023) by Freshworks
  • Gold Learner Award (2020) by IBM
  • Offerings Transformation Leadership award (2019) by IBM
  • Outstanding Initiative Leadership Award (2019) by IBM
  • Recognition Award (2017) by Wipro
  • Best CSR Volunteer Award (2016) by Accenture

Communication

Languages

  • English (Fluent)
  • Odia (Native)
  • Hindi (Fluent)
  • German (Elementary) - A1 level certified
  • Kannada (Elementary)

Colleague perspectives

Recommendations

Recommendations are retrieved from my LinkedIn profile and other public acknowledgements.

“One of the things I admire most about Soumendra is the rare combination of deep technical expertise and humility. As an Observability Architect and OpenTelemetry expert he brings a wealth of knowledge, yet he is always approachable and willing to help.

I often reached out to him with questions, ideas, and sometimes repeated nudges and he always responded with patience and thoughtful guidance. His recommendations are practical, insightful and focused on helping others succeed.

Our conversations frequently extended beyond observability into open-source initiatives, AI trends and personal projects. I’ve always appreciated how he challenges ideas with constructive feedback while encouraging innovation and learning. Those discussions have been incredibly valuable to me both professionally and personally.

I strongly recommend Soumendra to anyone looking for a highly skilled technologist, mentor and collaborative thought partner.”

Hemachandran Dhinakaran, Associate Manager, AI

“I had the pleasure of working with Soumendra at IBM. As an MCMP AIOps Platform squad lead, Soumendra showcased exceptional leadership and technical expertise, implementing multiple role-based user systems and a robust consumption-based pricing model.

As the AIOps Multi-Tenancy squad lead, he adeptly developed a multi-tenant architecture and seamlessly integrated user authentication via OpenID 2.0 in the ELK stack.

As an AI Solutions and Transformations Engineer, he excelled in analyzing complex product architectures and designing a unified ingestion and analytics framework, demonstrating a deep understanding of Big Data and Machine Learning technologies.

Soumendra’s contributions were invaluable, and their ability to solve complex technical challenges was commendable.”

Madhusoodanan K Madhavan, Enterprise Architect at IBM GTS Labs

“Soumendra is a tech powerhouse who transformed our MLOps initiatives at Freshworks. His deep passion for AI, combined with sharp technical acumen, enabled him to architect and deliver customer-ready solutions within a quarter. Beyond his technical prowess, his infectious smile and positive energy made every workday brighter. As a tech community builder and champion of both Python and Odia language, he brings a unique blend of skills to the table. If AI were to choose its own advocate, I’m pretty sure it would slide into Soumendra’s DMs first! Highly recommended.”

Sayan Nayak, Staff Engineer at Freshworks

“Undoubtedly, one of the most inspirational and knowledgeable Leaders I have worked with.

I had the pleasure of experiencing his leadership skills for over a year and it was easily one of the most eventful episodes in my work life.

His technical acumen and the flair to delight the customer is both commendable and inspirational.

An ability to stay focused for extraordinarily long duration and unending patience to resolve an issue, is a quality I would personally wish to imbibe and recommend for others.

As a team member or a leader, Soumendra earns my highest recommendation.”

Vishwanatha Krishnamurthy, Data Scientist at IBM GTS Labs, India

“We collaborated for around 3 years and it was a great honour to learn from Soumendra. He is one of the best in his field and is always willing to lead by example by sharing the best practices.

His wide set of skills and knowledge helped us increase our productivity, maximise growth and achieve the team deliverable. He is also very responsible and detail-oriented, qualities that make him stand out.

It was a pleasure working with him and I wish him the best in all his endeavours.”

Aman Jain, Data Scientist at IBM GTS Labs, India

“It was a pleasure working with Soumendra. He is a very hard working and sincere. He not only keeps himself up2date with the latest trends in technology but also openly imparts knowledge sharing sessions to his team members and colleagues. Soumendra’s ability to quickly scan through a new technology/concept, build a working prototype and do the demonstration is praise-worthy. Soumendra also believes in getting formal recognition for the new skills that he requires, thus has good number of certifications to his credit…

Soumendra is a very good team player. He leads by example but doesn’t hesitate to help his team members if they get stuck up. Owing to his pleasing personality and cool/calm work-style, Soumendra handles interlocks/exchanges across the teams very well. All of these aspects in Soumendra’s personality make him a great Technical Leader.

I wish Soumendra Best of Luck!!”

Manu Kuchhal, Senior Architect at IBM GTS Labs, India

“Soumendra has immense interest in learning newer things around AI, Contributed significantly on Wipro’s HOLMES Cognitive search product, throughout its inception to construction stages and supported the production rollouts. He has handled some of the customer deliveries single handedly, provided the customer demo’s, enabling the sales, improved the performance and accuracy of the Cognitive Search. Soumendra also mentored the junior team members & withstood the challenging times to achieve key deliveries along with quality process.”

Arvind Pattar, Head, Cognitive AI Systems at Wipro, India

“It was a great experience working with Soumendra in the [Freddy AI for Freshdesk] team. He consistently showcased innovation, building efficient ML systems that were both scalable and future-proof. One of Soumendra’s standout qualities is his exceptional documentation skills and attention to detail, which made it easy for the team to understand and build on his work effectively. His friendly and approachable nature made him a fantastic colleague and mentor. I highly recommend Soumendra for any opportunity that values innovation, expertise, and teamwork.”

Krithika Arunachalam, Senior Data Scientist at Freshworks

“I worked with Soumendra while building the AIOPS product at IBM. He leads the User Authorization and adding multi-tenancy in the application and has successfully done tons of POCs for proving new technologies or frameworks. He has always been a good team player and leads his team successfully for the overall application success.

I believe, he will play a key role in the success of any team that he is currently working in or the team he will be involved in as part of his future endeavor as well.”

Deepak Mahapatra, Senior Fullstack Developer at IBM, USA

“Soumendra is one of the best development engineer I had in my team. He has huge amount of skills to offer. Be it development, research, documentation, mentoring or guiding, he is first in all of them. He is role model for the whole team in so many ways. He guide team to do better coding. He promotes open source contributions. He is first in CSR activities.

Soumendra is full of ideas and suggestions. You give him any task, he bring multiples ways of achieve it and also provide new insights in what can be done better.

His coding style is among one of the best. His code, documentation for it, unit testing, integration, maintaining git is very methodical. His code was used as example in our project multiple times to demonstrate how it should be.

He is super active in CSR activities and do not shy off from taking any type of tasks in that. In Covid times, he helped community in so many different ways, which is very commendable.

It was great to have him in the team.”

Shaleen Tongia, Integration Architect and Development Engineering Manager at IBM GTS Labs, India

“Soumendra Kumar is a very good technical resource. He has strong hands-on experience in all full-stack technology. He is a self-motivated and result-orinated person. He has mentored my team in new technology and he keeps upskilling himself. He is very good team play. He has good data analytics and data visualization skill.”

Muniyandi Perumal, Full Stack Application Architect at IBM GTS Labs, India

“Soumendra is well versed in AI/ML, Python, React JS, Elastic Search technologies. Key team Player with very good skill on debugging code of other team mates. His documentation skill on git is very helpful for entire team. widely known for his open source contributions.”

Avinash Chandra Keshri, Team Lead at IBM GTS Labs, India

“I enjoyed working with Soumendra during PyCon India 2019’s CFP process. His dedication was unparalleled as he reviewed most proposals, ensuring all talks were finalized before the deadline. His unbiased and neutral reviews and attention to detail were instrumental to the conference’s success. I highly recommend Soumendra for any role valuing commitment, fairness, and a strong work ethic.”

Abhishek Yadav, PyCon India 2019 CFP Chair

“I worked with Soumendra in Wipro on the Cognitive Search platform. His NLP prowess, go to attitude and a positive smile made him a great team member. He is a continuous learner and loves to take newer challenges. He was an asset to our team. I wish him good luck in all his future endeavors.”

Udit Chandna, Product Manager at Wipro, India

“I know Soumendra since late 2018. We were working on Multi-Cloud Management Platform (MCMP) at IBM, he was in the India team and I was working out of Austin, TX. We were collaborating on building micro-services to support multi-tenancy for MCMP.

Our collaboration started little awkwardly but we developed a good rapport based on our shared enthusiasm for Python. We discussed writing efficent code, design patterns and tools on and off the project.

Though our official collaboration lasted for 6-8 months, to current date; we touch base with each other every now and then, and discuss programming and learning related things.

I enjoy discussing programming and everything else with Soumendra. And from my experience I can vouch for his programming skills and passion for building software. And he has been a really really nice human being.”

Vamshi Basupalli, Senior Fullstack Developer and Architect at IBM, USA

“Soumendra is very passionate developer with in depth technical skills. His coding standards and problem solving techniques are really amazing. He will be true asset for whichever organization he works for.”

Veeresh Bushetti, Team Lead at IBM GTS Labs, India

“Soumendra is: tech-savvy, Good Mentor, coordinates and manages project activities well.

He takes initiative to explore new solution possibilities that are useful and can implement working solution on the same.”

Sasi Kiran Patha, AI/ML Architect and Data Science Manager

“Soumendra is very good at taking ownership of Project activities and completing them till closure. He is a smart and intelligent co worker who is dedicated to his work and also mentoring his team. I can vouch for his Python coding skills and he can definitely do very good work in future projects. He is very very friendly person to be around and extremely gentle and helpful. I definitely recommend him for his future roles. Thanks, Shalini”

Shalini Garudayagari, Principal Technical Program Manager at Oracle

“I have known Soumendra as an extremely hard-working and highly intelligent person while working with him for JP Morgan Chase project at Accenture. He is a person who can take up the most challenging and difficult to-do task first. The entire team could rely on him to analyze and automate some of the most complex subject areas of our system. He is highly respected by his peers and senior team members.

Soumendra will be a great asset to any team he joins in future.”

Rashmi Singh, Application Development Senior Analyst at Accenture, India

“Soumendra was a great guy to work with. He is passionate towards work and was a dedicated team member which made him very dependable. He is a quick learner and grasps the way of working real fast. He has always delivered quality work on schedule which resulted in customer delight. He is a great team player and owns leadership qualities. He is always pumped and ready to take up additional responsibilities. Asks for feedback and makes improvement a habit.

Wish him all the very best for his future endeavors.”

Nirmal Singh, Team Lead at Tata Consultancy Services, India

“Soumendra was instrumental in successful completion of critical python project. His coordination with the extended team was awesome and he owned the complete delivery of the product. Appreciations from business and tech managers also echoed his dedication and hard work. He is a dependable person to have in a team.”

Biswajeet Chand, Manager, Workforce & Organisation at Capgemini Invent

“Soumendra has worked as part of the my team in Holmes platform in Wipro. He worked diligently. Despite busy schedule he always found time to take additional training for his peers. He actively contributed to different initiatives and solutions in the Holmes platform. Whenever there was need he stretched and ensure the customer commitments are met. He has a calm working and interaction style which will be a definite plus in a team.”

arthi v, Independent Developer

“I feel Soumendra is a great asset to any organization/Projects.. Not only he does a quality work but he also puts his best effort to deliver the work in a best and Smart way..Innovative and at the same time Committed to whatever assignments he has been given.. His curiosity to learn new things is another thing which will take him ahead ..So I feel a particular Technology wont be able to restrict him…Great Going.. Keep Learning at the same time.. All the best to Him in Future Ahead…”

Abhijeet Sahoo, Technical Project Manager and Program Delivery Lead

“working with soumendra was an exicitng experience. He is an excellent the team player and very detail-oreinted to produce quality results. Way of understanding the requirements and co-ordination with peers is remarkable.”

Prathyusha Pubbulati, Senior Software Engineer at Microsoft

Your turn

If any of this sounds like the help you need, write to me.

[email protected] What to put in a first message