Prompt Engineering is the icing on the cake how it changes the organization and the impact it will have, evolution of new job category and architecture.

1. Prompt & Circumstance: The GenAI Revolution
Crafting Queries, Crafting Futures: The GenAI Prompt Paradigm!
Author:Sanjay Sabnis ©
A Catalyst for Strategic Organizational Transformation

2. About Me
- Experience in Finance, IoT, Telecom, Technology
- Recipient of industry award for Data Security Tool
- OSS Enthusiast. Contributed to OS
- Built solutions for HiBD (HPC), GPU
- Loves Golf, Cycling, Hiking and AllAboutData
“There is Nothing Permanent Except Change”
-Heraclitus
My Favorite Quote

3. Author:Sanjay Sabnis ©
What is GenAI?
ChatGPT
LLM
FM
GenAI 1
2
3
4
An OpenAI Service that overlays conversational
chatbot with LLM to create content
AI that is trained on large amount of text to
interpret & generate human like text output
Large foundation ML models trained on broad
set of unlabeled data & are fine tuned
AI techniques that learn from data about the
existing artifacts & use this to generate new
artifact

4. “Crafting Queries, Crafting Futures:
The GenAI Prompt Paradigm!”
“The GenAI Prompt Paradigm!”
Let Us Prompt!!
Author:Sanjay Sabnis ©

5. What is a Prompt in Gen AI?
Author:Sanjay Sabnis ©
Prompt engineering is the practice of crafting and refining input prompts to optimize the
desired outputs from large language models (LLM) where you need high degree of accuracy.
(Basically Writing Code in English)
● It is Declarative.
● Just like SQL - It is a Structured English Language

6. It is an Art & a Skill
Prompt engineering is both a skill and an art, demanding creativity, experimentation, intuition, and
effective AI communication.
Few Important traits you need to be a great prompt engineer
- Curiosity
- Critical Thinking
- Consolidation
Author:Sanjay Sabnis ©
Repeat
Repeat
❏ Clear
❏ Concise
❏ Informative

7. Where Do We Start in an Enterprise?
The fundamental requirements for trained AI models and Effective Prompt
Engineering
- Prompt Engineering Management
- Training, Fine Tuning the AI model
- Qualified, Managed and Trustable Data
GenAI>?
Author:Sanjay Sabnis ©

8. What is Prompt Engineering Management?
➔ Planning
➔ Defining the language model objectives
➔ Understanding the desired outputs
➔ Identifying the type of prompts required.
Controlling resources to achieve desired outcome.
➔ Organizing
➔ Allocating resources
➔ Human expertise → Task of prompt creation and
refinement.
➔ Directing
➔ Overseeing the prompt engineering process.
➔ Guiding the team in iterative testing and refinement of
prompts.
➔ Controlling
➔ Evaluating the prompt performance
➔ Ensuring desired model responses
➔ Make necessary adjustments
Author:Sanjay Sabnis ©

9. Impending Challenges
Hallucination is a form of
Bias. Lead to bad
reputation, copyright
infringement, wrong
predictions etc.
❏ Data Sensitivity
❏ Access Control
❏ Data Complexity
❏ Regulatory & Compliance
❏ Misinterpretation
❏ Prompt Injection
❏ Temporal Relevance
❏ Scalability
❏ Training and Fine-Tuning
❏ Integration with Legacy Systems
❏ *Corpus (Language of the business model)
* * A corpus is a collection of authentic text or audio organized into datasets. ‘Authentic’ means text written or audio
spoken by a native of the language or dialect. A corpus comprises everything from newspapers, novels, recipes, and
radio broadcasts to television shows, movies, and tweets.
Author:Sanjay Sabnis ©

10. New Architecture
MDM/PDM DW Data Lake
Enterprise Business Data
Robust Data Quality & Governance
Data
Sources
CORPUS - Data Store
Sales Marketing Call
Center
Doc Repo Code Repo
Social Media Business Dialect ….
Model Training (GenAI)
Prompt Engineering Management
Regulatory & Compliance
Centralizing the data
across the org has huge
benefits.
Model Governance
Author:Sanjay Sabnis ©
Data Sensitivity
Data Retention
Auditing & Traceability Transparency & Explainability
International Considerations
Training Data
Prompt Engineering Framework

11. Prompt Engineering - Org Impact
Author:Sanjay Sabnis ©
➔ Decentralized Teams works better
100 Million ChatGPT Users in 60 Days
➔ AI Governance must expand to include prompt engineering
oversight/policy.
➔ Shadow AI must emerge out of it’s bunkers
➔ New Technology Roles/Titles will emerge
➔ Common set of tools and tech stack
➔ Increase in demand for business domain experience Tabnine
Code Generators
➔ Gap is closing - App Dev, Data Engineer, Data Scientist

12. ❖ Competitive Advantage
❖ Agility
❖ Innovation Mindset
❖ Collaboration
❖ Ethics & Responsibility
❖ Upskilling
❖ Experimentation
❖ Data Literacy
❖ New Roles & Teams
❖ Decision-Making Process
❖ Workflow Integration
❖ Technology Infrastructure
❖ Resource Allocation
Author:Sanjay Sabnis ©
is an icing on the cake
Structural Impact Cultural Impact Strategic Impact
In essence, prompt engineering is a gateway to unlocking the full potential of AI within the
enterprise, leading to smarter workflows, cost savings, and enhanced customer engagement.

13. GenAI$>KEEP PROMPTING_