My presentations at external conference and webinars

Designing Serverless Datalakes.

University of Columbia - Session 1

Microsoft Build 2025, Azure AI RedTeaming

Microsoft Build 2025, Keynote (check 51 min)

Delivering Data Governance using Machine Learning

University of Columbia - Session 2

‎TechPulse Junction: GenAI- Large Language Model (LLM) on Apple Podcasts

Connect with me @ Medium medium.com/@nayan.j.paul

Nayan Paul – MediumRead writing from Nayan Paul on Medium. https://www.linkedin.com/in/nayanjpaul/. Every day, Nayan Paul and thousands of other voices read, write, and share important stories on Medium.

Check out my New Books ! (all in Amazon)

Check out my University Lectures

My Patents and Publications

IDF - Patented Solution on Automated Data Pipelines for Data Lakes.

An intelligent data ingestion and governance method and system is disclosed. A set of data requirements is received from a user. The set of data requirements includes multiple different formats and corresponding location information indicating a plurality of corresponding different data sources. One or more data policies are also received from the user as part of the set of data requirements. A configuration file is automatically generated using the set of data requirements. A new dataset is retrieved from the plurality of corresponding different sources of data, using the generated configuration file. The retrieved dataset is classified, and metadata for the retrieved dataset is provided. Actionable policies are automatically generated using the metadata and the user defined data policies, and a compliance engine is generated. Security of access to the retrieved input data is controlled using the generated compliance engine. (more...)

https://patents.google.com/patent/US20200019558A1/en?inventor=nayanjyoti&oq=nayanjyoti

patents.justia.com/patent/20200019558

Practical Implementation of a Data Lake: Translating Customer Expectations into Tangible Technical Goals

Published Book - Designing Data Lakes from Ground Up (Awarded top books)

The 7 Pillars of Designing Well Architected Solution: A Practical Guide to Architecting Solutions for Hadoop

This book tries to provide measurable and tangible insights of how to design a “Well Architected Solution”. It then covers each pillar and tries to define strategy of what we need to deliver as part of the pillar.