SlideShare a Scribd company logo
1 of 59
Download to read offline
Copyright Global Data Strategy, Ltd. 2020
Data Architect vs. Data Engineer vs. Data Modeler
Donna Burbank
Global Data Strategy, Ltd.
October 22nd, 2020
Follow on Twitter @donnaburbank
@GlobalDataStrat
Twitter Event hashtag: #DAStrategies
Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2019. All rights reserved.
Diversity
Data Architect vs. Data Engineer vs. Data Modeler
Dynamically query data that
resides in AWS S3, on-demand
and in real-time
Focus on development without
worrying about synchronizing
data between operational and
analytical systems
Ingest, consolidate, and
analyze data from multiple
locations
NoSQL architecture that enables
flexible schema assigned when data
is read
2
Data Modeler
The data modeler, translates business rules into usable conceptual, logical, and physical
models and database designs.
Data Engineer
Query data in the Analytics
cluster using familiar SQL syntax
Utilize a fast, scalable, intuitive,
database, which speeds up the
development life cycle
Visualize data stored in the
cluster
Develop code that utilizes SDKs to
access data as needed
3
Data engineers specialize in big data solutions. They generally, work with data lakes, cloud
platforms, and data warehouses in the cloud.
Architect
Run analytical queries at scale
with a massively parallel
processing (MPP)
Maximize performance
Integrate data from disparate sources Dynamically scale as needed
4
The data architect needs to have a comprehensive mastery of all the technologies that all
other positions have.
Confidential and Proprietary. Do not distribute without
Couchbase consent. © Couchbase 2020. All rights reserved. 5
HYBRID CLOUD /
MULTI-CLOUD
STRATEGY
Cloud-agnostic
application deployment
and management
platform that treats cloud
providers like
commodities and enables
you to migrate between
clouds freely.
Couchbase.com
Customer Journey
7
Primary Needs Considerations Solution
Analyst
• Ease of use
• Compatibility with BI tools
Developer
• Performance
• Faster development life
cycle
Administrator
• Easy cluster management
Architect
• Performance
• ROI
• Support data-driven
decisions
Analyst
• Couchbase Analytics
service
Developer
• Couchbase Analytics
service
Administrator
• Couchbase Analytics
service
Architect
• Couchbase Analytics
service
Analyst
• Easily access data
• Analyze data
• Produce reports
Developer
• Write code that utilizes
SDKs to access cluster
data
Administrator
• Easily manage cluster
Architect
• Dynamically scale as
needed
• Maximize performance
The following slides illustrate the demo flow for the Couchbase Connect keynote
demo - narrative text is solely to convey context, this is not a script!
The slides follow the outline detailed here
NOTE: Screenshots are for concept illustration only, they are not the actual screens
we show in the demo
Text in RED represents areas where Ravi could interrupt with a leading question
Data Architect, Data Engineer, Data Modeler for Big data projects.
Registration
https://content.dataversity.net/102220-Data-Architecture-Webinar_Sponsor-
Registration-Couchbase.html
Review Material
https://www.dataversity.net/data-architect-vs-data-modeler-vs-data-engineer/
Persona Describe
A Data Architect …. Data architects are for large organizations that need vision across all data activities.
If the data scientist is on the fast track, the data architect is on the slow track. The data architect needs to have a comprehensive mastery of all the technologies that all other
positions have, as well as the personality and skill to work successfully and gracefully with both IT and business people. “It takes a lot of experience to become a data architect.
You can’t go to school and graduate and have this level of experience,” said Bowers.
A Data Engineer …. Data engineers specialize in big data solutions, but technology and techniques are too new to provide guaranteed success. Ensure new hires are carefully
vetted for skills and experience.
The data engineer does the same work as the BI engineer, but using big data, which results in an average salary increase of $10,000. Rather than working with on-premise
technologies, Data engineers work with data lakes, cloud platforms, and data warehouses in the cloud. “More cutting edge technology makes you more money, even if you just
perform the same function for your business,” he said
A Data Modeler ….
● You get what you pay for, so hire good data modelers and pay them well. Find an expert hiring firm with experience specifically hiring data modelers.
● A software engineer who is good at Data Modeling is more expensive but delivers the best results.
Data modelers work with data architects and DBA designers and developers to model data, translating business rules into usable conceptual, logical, and physical models and
database designs. Good data modelers are highly valued by the enterprise and this is one situation where a simple change in title can increase salary — if the modeling skills are
there, he said. “A lot of people think they model data well, and they don’t.” Data Modeling is an art, he said, and because it’s such a hard job to do well, modelers get paid well if
they do it well.
Bowers had warnings for businesses looking to hire a data modeler. “Because everybody claims to be a good data modeler,” it’s important to interview and evaluate thoroughly
to ensure that candidates have proven modeling skills. Bad data models make data integration very difficult, and apps based on flawed models can never perform properly, he
said. “It’s a huge value add to get a good data modeler.”
Data Analyst
Easily access data in Analytics
cluster
Use BI tools to create matrices
and reports
Create SQL based queries to
analyze data
Use predictive analytics software with
cluster data
1
0
Architect
Run analytical queries at scale
with a massively parallel
processing (MPP)
Analyze data using
independent nodes, isolated
from operational workloads
.
Optimize analytical queries
using multi-dimensional
scaling
Integrate data from disparate sources
1
1
Business Analyst
Visualize data stored in the
cluster
Perform trend analysis of
business data
Query data in the Analytics
cluster using SQL syntax
Dynamically query data that resides
in AWS S3, on-demand
1
2
Administrator
Easily adapt and manage
architecture
Scale cluster up and down
and respond to node crashes
Support workload isolation
Simplify operations with analytical
and operational workloads in a single
platform
1
3
USER PERSONA REQUIREMENTS
L o r e m i p s u m
Lorem ipsum dolor sit amet, consectetur
adipiscing elit. Morbi et rutrum felis, eget
tristique tortor.
Lorem
ipsum
Lorem
ipsum
Lorem
ipsum
Lorem ipsum dolor sit amet, consectetur
adipiscing elit. Morbi et rutrum felis, eget
tristique tortor.
Lorem
ipsum
Lorem
ipsum
Lorem
ipsum
Lorem ipsum dolor sit amet, consectetur
adipiscing elit. Morbi et rutrum felis, eget
tristique tortor.
Lorem
ipsum
Lorem
ipsum
Lorem
ipsum
L o r e m i p s u m
L o r e m i p s u m
1
4
Introduction
Introduce the application concept and goals
with slides
INTRO narrative on page 3 here
Slide to introduce the application requirements
at a high level - (not functional reqs)
1 2
Briefly show application as “in-progress / in-development”
APPLICATION WILL NOT HAVE FTS/EVENTING/TRANSACTIONS/EMBEDDED BI YET
Show SDK pages to make it clear there are
tons of developer resources: “We used the
Spring Data SDK and Java SDK to implement
the application, it made getting started a snap!”
Lets see the application so far (short overview -
not showing the omitted pieces)
3 4
N1QL showcase
“One of the reasons the application is so easy to build is thanks to N1QL! We just use plain SQL in our code to
communicate with Couchbase!”
Interrupt - “OK then, show us how easy it is to query JSON using SQL!”
Heres the Couchbase Management
Console - it has a query editor built
right in! See I am using a simple SQL
select here - easy right?
Interrupt:
“Thats great,
but does N1QL
support SQL
constructs like
joins?”
Yes it does, here we will join across 2
document types in our query - TRY THAT
WITH MongoDB!
5 6
INDEX ADVISOR showcase
“Performance is a big goal of the application, and Couchbase has features to help optimize...”
RUN A SLOOOW QUERY:
“Here’s another query using N1QL’s
simple SQL syntax - this one returns
<user profile information for login?>, but
it’s not the fastest query in the
world…….”
Interrupt: “That
query is
running pretty
slow, but its for
a CRITICAL
FEATURE!
what can
Couchbase do
to help with
that?”
“JSON doc databases rely on indexing for
performance, due to the docs hierarchical
schemaless nature - but if you aren’t an
expert at indexing Couchbase INDEX
ADVISOR can help!” - show running the
ADVISOR
7 8
INDEX ADVISOR showcase
Click CREATE AND BUILD INDEXES:
“Couchbase does the work for me! All I
have to do is run the advisor, then set
the recommended indexes! How easy is
that!”
“Now when we re-run the query, it’s
lightning fast due to the indexes - thanks
to Couchbase INDEX ADVISOR!”
9 10
USER MANAGEMENT showcase
Interrupt - “Ok, lets start with table stakes - USER MANAGEMENT. Every app needs it, and every developer has
implemented it, does Couchbase make it better or easier?”
Show User Management data in Couchbase UI
“Sure thing, as I mentioned in the intro, we
expect tons of users, logging in concurrently
from all over the world - Couchbase has the
scale and efficiency to handle it…..heres a user
in Event Sprint - in a relational DB user info is
all across multiple tables - in JSON the user is
encapsulated in a single doc - making it more
efficient to store and easier to query”
“...and Event Sprint handles it here in the
code” <show N1QL if possible, show
whatever makes sense to depict user
mgmt>. “..and here’s the final experience in
the UI…”. Show the UI. “BUT! Couchbase
does so much more than just this user
mgmt!............”
11 12
FTS showcase
Interrupt - “Ok, lets get a little more sophisticated. App users want to find specific things fast, and you have lots of
nuanced info about events and talks in the app, how can users find what they’re looking for?”
Show Couchbase UI - FTS settings:
“Glad you asked! We do want to allow
searching in the app, and we also want
to auto suggest, as well as prevent
duplicate topic submissions. We’ll use
CB FTS - Here I’ll enable an FTS index:”
Show setting index - so easy!
Test the new index to show how it works
“We can even test the search directly in the
UI!”
13 14
FTS showcase
Show application code:
“Not only is FTS easy to set, it’s just as
easy to call from our app” Paste
appropriate code into the app to enable
search. Show how it’s simple to call
using N1QL. Refresh app
Show searching events in the application
“FTS is built right in to Couchbase, no
bolting on Solr or Elastic Search. Another
enterprise feature was so easy to add!”
15 16
TRANSACTONS showcase
Interrupt - “Ok, here’s another one for you. We all know that updating lots of database records at the same time is
costly, how do you perform updates across multiple documents without incurring the overhead?”
Show application code:
“Couchbase offers a TRANSACTIONS
feature for just such a case. Lets say we want
to transfer credits from one user to another -
all we have to do is call the TRANSACTIONS
function and the documents are updated with
no overhead” Paste appropriate code into the
app. Show how it’s simple to call using
N1QL. Refresh app
In UI, show credits being moved from user a
to user b
17 18
EVENTING showcase: Interrupt - “So, everyone expects a proactive experience these days, for example users
will expect to be notified about activity in the application around their talks, and to understand social interest
towards their talks - not have to go looking for it. How can you kick off a social analysis and proactively alert users,
even if they arent on the app?”
Show Couchbase UI Eventing editor:
“Eventing is built for use cases like this, it can
call out to any external service based on a
change in the data. In this case after a talk,
we’ll call a service that searches for social
feedback on the talk and emails the info to
users - lets say a given talk has completed, we
want to alert everyone on the social feedback”
Save the script
Go to Event Sprint, check “track social media” for a
given talk. Click SAVE.
A NEW EMAIL ALERT POPS ON SCREEN
Open email, it’s the notification!
Calling ext srvcs opens many opps for eventing
such as: Cascading deletes,
Store history of doc changes (fraud detection),
event sourcing/logging (fraud detection)
19 20
BI showcase
Interrupt - “How about measuring the users acitivity - how easy is it to analyze the data, and even add it to the
UI?”
Show application code:
“Since we can use plain SQL, analyzing and
visualizing the data is easy!” Paste
appropriate code into the app to query data
and visualize it in ChartJS visualization
library. Show how it’s simple using N1QL.
Refresh app
Show charts in the app UI
2221
S3 showcase
Interrupt - “..Thats great for data stored in Couchbase, but what about data stored elsewhere, such as archived
data stored in Amazon S3?, can we analyze that too?”
CBS UI - Show ANALYTICS feature:
“Couchbase include an MPP just for
analytics! It makes quick work of analyzing
the massive amount of information we
expect to collect” Show the analytics
query editor “..it leverages a separate
engine optimized for analytic queries”
23 24
Show AWS S3 bucket in AWS console
“We harvest talk rating data from the event
hosts and store it in S3” Show the analytics
query editor “..in the query editor, we can
quickly create a reference to the external
data in S3...now we can query it through
Couchbase using SQL!” Show sample
query and result
BI showcase
Interrupt - “How about using a BI tool?”
Show Power BI report:
“N1QL’s SQL paradigm means you can use any BI
tool with Couchbase! Here I’m mapping all the events
across the country using a simple query to the
database. <optionally mention/show CData driver>.
“Lets embed it to the application!” Copy embed code
25
BI showcase
Show Event Sprint with embedded report:
“N1QL’s SQL paradigm makes using BI tools
with Couchbase so easy! And embedding is
just as easy!
In app code, add the embed code…..
2726
CI CD showcase - on AWS
Interrupt - “Alright, the app looks great, I think it’s ready for prime time! Since you expect tons of users, how do
you deploy for scale? Is it just as easy as everything else? And when if you make changes to the app or data,
does that mess up an easy deployment?”
28
FLAG
Add a new field to the data in Couchbase UI
“Sure thing, lets deploy our updated app, and to
make it more realworld, I’ll add a new field to
the data” - add new field to user profile.
29
Add a new cluster node in Couchbase UI
“I’ll even add a new node to the cluster to make
sure we can handle the traffic”
CI CD showcase
30
DEPLOY APPLICATION TO CLUSTER
31
Show the the application has inherited the new
field
COUCHBASE SERVER
CONSOLE
AWS AS NECESSARY
CI CD showcase
32
FAILOVER SIMULATION
33
Application stays up, even with a failure in the
cluster!
COUCHBASE SERVER
CONSOLE
AWS AS NECESSARY
Copyright Global Data Strategy, Ltd. 2020
Data Architect vs. Data Engineer vs. Data Modeler
Donna Burbank
Global Data Strategy, Ltd.
October 22nd, 2020
Follow on Twitter @donnaburbank
@GlobalDataStrat
Twitter Event hashtag: #DAStrategies
Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com
Donna Burbank
2
Donna is a recognised industry expert in
information management with over 20 years
of experience in data strategy, information
management, data modeling, metadata
management, and enterprise architecture.
Her background is multi-faceted across
consulting, product development, product
management, brand strategy, marketing, and
business leadership.
She is currently the Managing Director at
Global Data Strategy, Ltd., an international
information management consulting company
that specializes in the alignment of business
drivers with data-centric technology. In past
roles, she has served in key brand strategy
and product management roles at CA
Technologies and Embarcadero Technologies
for several of the leading data management
products in the market.
As an active contributor to the data
management community, she is a long time
DAMA International member, Past President
and Advisor to the DAMA Rocky Mountain
chapter, and was awarded the Excellence in
Data Management Award from DAMA
International.
Donna is also an analyst at the Boulder BI
Train Trust (BBBT) where she provides advice
and gains insight on the latest BI and Analytics
software in the market. She was on several
review committees for the Object
Management Group’s for key information
management and process modeling
notations.
She has worked with dozens of Fortune 500
companies worldwide in the Americas,
Europe, Asia, and Africa and speaks regularly
at industry conferences. She has co-authored
two books: Data Modeling for the
Business and Data Modeling Made Simple
with ERwin Data Modeler and is a regular
contributor to industry publications. She can
be reached at
donna.burbank@globaldatastrategy.com
Donna is based in Boulder, Colorado, USA.
Follow on Twitter @donnaburbank
@GlobalDataStrat
Twitter Event hashtag: #DAStrategies
Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com
DATAVERSITY Data Architecture Strategies
• January 23 Emerging Trends in Data Architecture – What’s the Next Big Thing?
• February 27 Building a Data Strategy - Practical Steps for Aligning with Business Goals
• March 26 Cloud-Based Data Warehousing – What's New and What Stays the Same
• April 23 Master Data Management – Aligning Data, Process, and Governance
• May 28 Data Governance and Data Architecture – Alignment and Synergies
• June 25 Enterprise Architecture vs. Data Architecture
• July 22 Best Practices in Metadata Management
• August 27 Data Quality Best Practices
• September 24 Data Virtualization – Separating Myth from Reality
• October 22 Data Architect vs. Data Engineer vs. Data Modeler
• December 1 Graph Databases: Practical Use Cases
3
This Year’s Lineup
Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com
3
What We’ll Cover Today
4
• The increasing focus on data in today’s organization has increased demand for critical
roles such as data architect, data engineer, and data modeler.
• But there is often confusion and ambiguity around what these roles entail, and what
overlap exists between them.
• This webinar will discuss these data-centric roles and their place in the data-driven
organization.
Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com
Audience
5
There exists a great deal of confusion and differing terminology in the data management industry.
This webinar has generated a great deal of pre-interest from, at a minimum, two main audiences:
Those Hiring
Those Looking
for Work
“How do I get the right mix of skills on my team?”
“How do I find someone who understands my
business?”
“Where are the right people to help us build our
data-driven vision?”
“How do I position my skills effectively?”
“How do I find the right role that fits my strengths
and interests?”
“What’s the right company to help me grow?”
Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com
The Role of the Data Professional
in the Data-Driven Business
• In the current environment of data-driven business, Data Professionals have an opportunity to
have a “seat at the table”
• Finding new opportunities to leverage data for business benefit
• Creating efficiencies & business process optimization
• Integrating data from disparate sources for new business insights
• Supporting organizational change
6
Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com
Data Roles are HOT in today’s market
… (and the importance of data quality…)
7
Architect
Data-centric roles are in high demand,
particularly those who can “speak the
language” of both business and technology.
Often, that role is a data architect.
Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com
The Role of the Data Architect
8
Technology Business
Janus
Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com
What is in a Name?
9
• There are a number of data-centric roles that are common, and we’ll explore these today:
• Data Architect
• Data Engineer
• Data Modeler
• And there are many, many more in common use. These are a subset of title from data
professionals in my network:
• Database administrator, DBA, Data platform administrator, Data platform architect, Data guru, Data
whisperer, Chief Data Officer, Cloud Data Architect, Semantic modeler, Data Strategist, ETL Developer,
ELT Developer, Data manager, Data Governance Manager, Head of Data, Data Lead, Data Innovation
Lead, Data consultant, Data analyst, etc., etc.
• It’s Clear that this is confusing…
Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com
3
Architecture vs. Construction
• It’s a common analogy to use building architecture as an analogy to data architecture.
• When constructing a building, there is a clear distinction between designing a house and building a house.
10
Design Build
Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com
Architects vs. Engineers vs. Builders
11
• Similarly, there is a clear distinction between architects, engineers, builders who build the house.
I work with the owner to understand their
needs and draw the diagrams to match
their requirements.
I work onsite to make sure that the
building is structurally sound.
I swing the hammer to make sure
the house gets built.
Architect Engineer Builder
Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com 12
• Unfortunately, with data professionals, the distinctions aren’t as obvious.
I work with the owner to understand their
needs and draw the diagrams to match
their requirements.
I make sure that the data platform
is structurally sound.
I write code to ensure working
applications and databases.
Architect Engineer Builder
Architects vs. Engineers vs. Builders
Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com
3
Architecture vs. Construction
13
• When constructing a database, there is a clear distinction between
designing and building.
Design Build
Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com
3
Architecture vs. Construction
14
Solution Design Database Design Database Build
• This expands to the overall solution architecture as well, i.e. how the various components
and platforms fit together.
Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com
3
Is “All in One” Possible?
15
• In the construction world, there are
contractors who can perform a mix of
Design and Build capabilities.
• For small projects, this might be the same
person.
• Is the same true in the data industry?
Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com
The Data Roles & Skills Spectrum
16
Platform
Infrastructure
• Server & hardware setup
• Cloud platform configuration
• Backup and Recovery
• Etc.
Data-centric
Business Vision
& Design
Business
Requirements
Data Landscape
Vision & Design
Data Landscape
Execution
Database / Data Store
Vision & Design
Database / Data Store
Execution
• Business Model Design
• P&L Responsibility
• Etc.
CEO
CDO
Strategist
• Business Capability Models
• Business Process Models
• Design Thinking
• Conceptual Data Model
• System Architecture
Diagrams
• Data Flow Diagrams
• New Technology
Exploration
• Data platform
configuration
• Data integration
• Performance & tuning
• Etc.
Data Architect
Business Analyst
Enterprise Architect
Data Modeler
Data Architect
Solution Architect
• Data models
• Data store selection
• Glossary
• Semantic layer
• Etc.
Data Engineer
Data Integrator
ETL Developer
Data Architect
Data Modeler
Data Engineer
• Database creation
• Data store
implementation
• Performance &
tuning
• Etc.
Data Engineer
DBA
Infrastructure
Engineer
• There is a wide variety of roles involved in a successful data initiative
⁻ from Business Vision to Platform Infrastructure
⁻ … and everything in-between
Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com
Data Architect
17
Platform
Infrastructure
• Server & hardware setup
• Cloud platform configuration
• Backup and Recovery
• Etc.
Data-centric
Business Vision
& Design
Business
Requirements
Data Landscape
Vision & Design
Data Landscape
Execution
Database / Data Store
Vision & Design
Database / Data Store
Execution
• Business Model Design
• P&L Responsibility
• Etc.
CEO
CDO
Strategist
• Business Capability Models
• Business Process Models
• Design Thinking
• Conceptual Data Model
• System Architecture
Diagrams
• Data Flow Diagrams
• New Technology
Exploration
• Data platform
configuration
• Data integration
• Performance & tuning
• Etc.
Data Architect
Business Analyst
Enterprise Architect
Data Modeler
Data Architect
Solution Architect
• Data models
• Data store selection
• Glossary
• Semantic layer
• Etc.
Data Engineer
Data Integrator
ETL Developer
Data Architect
Data Modeler
Data Engineer
• Database creation
• Data store
implementation
• Performance &
tuning
• Etc.
Data Engineer
DBA
Infrastructure
Engineer
Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com
Data Modeler
18
Platform
Infrastructure
• Server & hardware setup
• Cloud platform configuration
• Backup and Recovery
• Etc.
Data-centric
Business Vision
& Design
Business
Requirements
Data Landscape
Vision & Design
Data Landscape
Execution
Database / Data Store
Vision & Design
Database / Data Store
Execution
• Business Model Design
• P&L Responsibility
• Etc.
CEO
CDO
Strategist
• Business Capability Models
• Business Process Models
• Design Thinking
• Conceptual Data Model
• System Architecture
Diagrams
• Data Flow Diagrams
• New Technology
Exploration
• Data platform
configuration
• Data integration
• Performance & tuning
• Etc.
Data Architect
Business Analyst
Enterprise Architect
Data Modeler
Data Architect
Solution Architect
• Data models
• Data store selection
• Glossary
• Semantic layer
• Etc.
Data Engineer
Data Integrator
ETL Developer
Data Architect
Data Modeler
Data Engineer
• Database creation
• Data store
implementation
• Performance &
tuning
• Etc.
Data Engineer
DBA
Infrastructure
Engineer
Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com
Data Engineer
19
Platform
Infrastructure
• Server & hardware setup
• Cloud platform configuration
• Backup and Recovery
• Etc.
Data-centric
Business Vision
& Design
Business
Requirements
Data Landscape
Vision & Design
Data Landscape
Execution
Database / Data Store
Vision & Design
Database / Data Store
Execution
• Business Model Design
• P&L Responsibility
• Etc.
CEO
CDO
Strategist
• Business Capability Models
• Business Process Models
• Design Thinking
• Conceptual Data Model
• System Architecture
Diagrams
• Data Flow Diagrams
• New Technology
Exploration
• Data platform
configuration
• Data integration
• Performance & tuning
• Etc.
Data Architect
Business Analyst
Enterprise Architect
Data Modeler
Data Architect
Solution Architect
• Data models
• Data store selection
• Glossary
• Semantic layer
• Etc.
Data Engineer
Data Integrator
ETL Developer
Data Architect
Data Modeler
Data Engineer
• Database creation
• Data store
implementation
• Performance &
tuning
• Etc.
Data Engineer
DBA
Infrastructure
Engineer
Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com
Don’t Be Afraid to Go “Off Course”
• Don’t be afraid to take a roll that’s new or unexpected – you never know where it will lead you!
20
Degrees in
Economics & English
Temp Jobs from Finance to
Manufacturing in College
DC Economic
Think Tank
Degree in
Computer Science
Consultant – Data Mgt
Consultant – EMEA
Programmer Product Management
Product Marketing
Consultant – Business
Transformation & Data Mgt
Managing Director, Global Data Strategy, Ltd
What’s Next?
Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com
Advice for Data Professionals Looking to Expand
21
3
• Build on your strengths
• Do you have domain-specific knowledge in Finance, Manufacturing, Health Care, etc?
• Are you a good communicator?
• Do you love learning new technology?
• Are you a “big picture” thinker – can you connect concepts in a coherent, concise way?
• Expand your knowledge
• What technical areas can you expand? Online learning options abound!
• How can you improve your communication? Toastmasters and other groups can help.
• Expand your network
• Online platforms such as Linkedin
• Data-centric organizations such as DAMA (Data Management Professionals Association)
• Online conferences and venues (e.g. Dataversity)
Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com
3
Summary
• There is a great deal of opportunities for data
professionals in today’s market
• A broad range of skills are needed for a successful
data initiative.
• Don’t be afraid to broaden skills into other areas
• But at the same time, be clear on roles and
accountability.
Best of luck on your data projects!
Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com
About Global Data Strategy™, Ltd
• Global Data Strategy™ is an international information management consulting company that
specializes in the alignment of business drivers with data-centric technology.
• Our passion is data, and helping organizations enrich their business opportunities through data and
information.
• Our core values center around providing solutions that are:
• Business-Driven: We put the needs of your business first, before we look at any technology solution.
• Clear & Relevant: We provide clear explanations using real-world examples.
• Customized & Right-Sized: Our implementations are based on the unique needs of your organization’s
size, corporate culture, and geography.
• High Quality & Technically Precise: We pride ourselves in excellence of execution, with years of
technical expertise in the industry.
23
Data-Driven Business Transformation
Business Strategy
Aligned With
Data Strategy
Visit www.globaldatastrategy.com for more information
Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com
3
We’re Hiring!
24
Visit https://globaldatastrategy.com/about/careers/ for more info
Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com
DATAVERSITY Data Architecture Strategies
• January 23 Emerging Trends in Data Architecture – What’s the Next Big Thing?
• February 27 Building a Data Strategy - Practical Steps for Aligning with Business Goals
• March 26 Cloud-Based Data Warehousing – What's New and What Stays the Same
• April 23 Master Data Management – Aligning Data, Process, and Governance
• May 28 Data Governance and Data Architecture – Alignment and Synergies
• June 25 Enterprise Architecture vs. Data Architecture
• July 22 Best Practices in Metadata Management
• August 27 Data Quality Best Practices – with Nigel Turner
• September 24 Data Virtualization – Separating Myth from Reality
• October 22 Data Architect vs. Data Engineer vs. Data Modeler
• December 1 Graph Databases: Practical Use Cases
25
Join us next month
Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com
Questions?
26
• Thoughts? Ideas?

More Related Content

What's hot

The ABCs of Treating Data as Product
The ABCs of Treating Data as ProductThe ABCs of Treating Data as Product
The ABCs of Treating Data as ProductDATAVERSITY
 
Best Practices in Metadata Management
Best Practices in Metadata ManagementBest Practices in Metadata Management
Best Practices in Metadata ManagementDATAVERSITY
 
DW Migration Webinar-March 2022.pptx
DW Migration Webinar-March 2022.pptxDW Migration Webinar-March 2022.pptx
DW Migration Webinar-March 2022.pptxDatabricks
 
Data Quality Best Practices
Data Quality Best PracticesData Quality Best Practices
Data Quality Best PracticesDATAVERSITY
 
Data platform architecture
Data platform architectureData platform architecture
Data platform architectureSudheer Kondla
 
Data-Ed Slides: Best Practices in Data Stewardship (Technical)
Data-Ed Slides: Best Practices in Data Stewardship (Technical)Data-Ed Slides: Best Practices in Data Stewardship (Technical)
Data-Ed Slides: Best Practices in Data Stewardship (Technical)DATAVERSITY
 
Data Governance and Metadata Management
Data Governance and Metadata ManagementData Governance and Metadata Management
Data Governance and Metadata Management DATAVERSITY
 
DMBOK 2.0 and other frameworks including TOGAF & COBIT - keynote from DAMA Au...
DMBOK 2.0 and other frameworks including TOGAF & COBIT - keynote from DAMA Au...DMBOK 2.0 and other frameworks including TOGAF & COBIT - keynote from DAMA Au...
DMBOK 2.0 and other frameworks including TOGAF & COBIT - keynote from DAMA Au...Christopher Bradley
 
Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?DATAVERSITY
 
You Need a Data Catalog. Do You Know Why?
You Need a Data Catalog. Do You Know Why?You Need a Data Catalog. Do You Know Why?
You Need a Data Catalog. Do You Know Why?Precisely
 
Data Quality & Data Governance
Data Quality & Data GovernanceData Quality & Data Governance
Data Quality & Data GovernanceTuba Yaman Him
 
Building a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business GoalsBuilding a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business GoalsDATAVERSITY
 
Data Mesh for Dinner
Data Mesh for DinnerData Mesh for Dinner
Data Mesh for DinnerKent Graziano
 
Data Catalog for Better Data Discovery and Governance
Data Catalog for Better Data Discovery and GovernanceData Catalog for Better Data Discovery and Governance
Data Catalog for Better Data Discovery and GovernanceDenodo
 
Data Lake Overview
Data Lake OverviewData Lake Overview
Data Lake OverviewJames Serra
 
Modern Data architecture Design
Modern Data architecture DesignModern Data architecture Design
Modern Data architecture DesignKujambu Murugesan
 
Introduction to Data Governance
Introduction to Data GovernanceIntroduction to Data Governance
Introduction to Data GovernanceJohn Bao Vuu
 
Data Governance Best Practices
Data Governance Best PracticesData Governance Best Practices
Data Governance Best PracticesBoris Otto
 
Data Architecture Strategies: Data Architecture for Digital Transformation
Data Architecture Strategies: Data Architecture for Digital TransformationData Architecture Strategies: Data Architecture for Digital Transformation
Data Architecture Strategies: Data Architecture for Digital TransformationDATAVERSITY
 

What's hot (20)

The ABCs of Treating Data as Product
The ABCs of Treating Data as ProductThe ABCs of Treating Data as Product
The ABCs of Treating Data as Product
 
Best Practices in Metadata Management
Best Practices in Metadata ManagementBest Practices in Metadata Management
Best Practices in Metadata Management
 
DW Migration Webinar-March 2022.pptx
DW Migration Webinar-March 2022.pptxDW Migration Webinar-March 2022.pptx
DW Migration Webinar-March 2022.pptx
 
Data Quality Best Practices
Data Quality Best PracticesData Quality Best Practices
Data Quality Best Practices
 
Data platform architecture
Data platform architectureData platform architecture
Data platform architecture
 
Data-Ed Slides: Best Practices in Data Stewardship (Technical)
Data-Ed Slides: Best Practices in Data Stewardship (Technical)Data-Ed Slides: Best Practices in Data Stewardship (Technical)
Data-Ed Slides: Best Practices in Data Stewardship (Technical)
 
Data Governance and Metadata Management
Data Governance and Metadata ManagementData Governance and Metadata Management
Data Governance and Metadata Management
 
DMBOK 2.0 and other frameworks including TOGAF & COBIT - keynote from DAMA Au...
DMBOK 2.0 and other frameworks including TOGAF & COBIT - keynote from DAMA Au...DMBOK 2.0 and other frameworks including TOGAF & COBIT - keynote from DAMA Au...
DMBOK 2.0 and other frameworks including TOGAF & COBIT - keynote from DAMA Au...
 
Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?
 
You Need a Data Catalog. Do You Know Why?
You Need a Data Catalog. Do You Know Why?You Need a Data Catalog. Do You Know Why?
You Need a Data Catalog. Do You Know Why?
 
Data Quality & Data Governance
Data Quality & Data GovernanceData Quality & Data Governance
Data Quality & Data Governance
 
Building a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business GoalsBuilding a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business Goals
 
Data Mesh for Dinner
Data Mesh for DinnerData Mesh for Dinner
Data Mesh for Dinner
 
Data Catalog for Better Data Discovery and Governance
Data Catalog for Better Data Discovery and GovernanceData Catalog for Better Data Discovery and Governance
Data Catalog for Better Data Discovery and Governance
 
Data Lake Overview
Data Lake OverviewData Lake Overview
Data Lake Overview
 
8 Steps to Creating a Data Strategy
8 Steps to Creating a Data Strategy8 Steps to Creating a Data Strategy
8 Steps to Creating a Data Strategy
 
Modern Data architecture Design
Modern Data architecture DesignModern Data architecture Design
Modern Data architecture Design
 
Introduction to Data Governance
Introduction to Data GovernanceIntroduction to Data Governance
Introduction to Data Governance
 
Data Governance Best Practices
Data Governance Best PracticesData Governance Best Practices
Data Governance Best Practices
 
Data Architecture Strategies: Data Architecture for Digital Transformation
Data Architecture Strategies: Data Architecture for Digital TransformationData Architecture Strategies: Data Architecture for Digital Transformation
Data Architecture Strategies: Data Architecture for Digital Transformation
 

Similar to Here are a few ways Couchbase could showcase full-text search capabilities:- Demonstrate building a simple full-text index on a document field and querying it using the FTS syntax. For example, indexing a product description field and searching for products containing specific keywords. - Show how FTS supports features like stemming, wildcards, proximity search, etc. to make searches more flexible and return better results. - Highlight how FTS indexes can be built on multiple fields to enable cross-field searches. For example, searching across product name and description fields.- Compare performance of FTS queries against non-indexed queries to show the benefits of indexing for search. - If data volume allows, showcase

Steps towards business intelligence
Steps towards business intelligenceSteps towards business intelligence
Steps towards business intelligenceAhsan Kabir
 
Microsoft education for it professionals
Microsoft education for it professionalsMicrosoft education for it professionals
Microsoft education for it professionalsHadshana Kamalanathan
 
Mark Simpson - UKOUG23 - Refactoring Monolithic Oracle Database Applications ...
Mark Simpson - UKOUG23 - Refactoring Monolithic Oracle Database Applications ...Mark Simpson - UKOUG23 - Refactoring Monolithic Oracle Database Applications ...
Mark Simpson - UKOUG23 - Refactoring Monolithic Oracle Database Applications ...marksimpsongw
 
Enter the World of PowerApps - Canvas vs. Model-Driven Apps
Enter the World of PowerApps - Canvas vs. Model-Driven AppsEnter the World of PowerApps - Canvas vs. Model-Driven Apps
Enter the World of PowerApps - Canvas vs. Model-Driven AppsDaniel Laskewitz
 
Software architecture patterns
Software architecture patternsSoftware architecture patterns
Software architecture patternsMd. Sadhan Sarker
 
Modern Business Intelligence and Advanced Analytics
Modern Business Intelligence and Advanced AnalyticsModern Business Intelligence and Advanced Analytics
Modern Business Intelligence and Advanced AnalyticsCollective Intelligence Inc.
 
SPS Vancouver 2018 - What is CDM and CDS
SPS Vancouver 2018 - What is CDM and CDSSPS Vancouver 2018 - What is CDM and CDS
SPS Vancouver 2018 - What is CDM and CDSNicolas Georgeault
 
DBT ELT approach for Advanced Analytics.pptx
DBT ELT approach for Advanced Analytics.pptxDBT ELT approach for Advanced Analytics.pptx
DBT ELT approach for Advanced Analytics.pptxHong Ong
 
SQL to NoSQL: Top 6 Questions
SQL to NoSQL: Top 6 QuestionsSQL to NoSQL: Top 6 Questions
SQL to NoSQL: Top 6 QuestionsMike Broberg
 
Democratization of Data @Indix
Democratization of Data @IndixDemocratization of Data @Indix
Democratization of Data @IndixManoj Mahalingam
 
Microsoft cloud big data strategy
Microsoft cloud big data strategyMicrosoft cloud big data strategy
Microsoft cloud big data strategyJames Serra
 
Tableau Seattle BI Event How Tableau Changed My Life
Tableau Seattle BI Event How Tableau Changed My LifeTableau Seattle BI Event How Tableau Changed My Life
Tableau Seattle BI Event How Tableau Changed My LifeRussell Spangler
 
How to Survive as a Data Architect in a Polyglot Database World
How to Survive as a Data Architect in a Polyglot Database WorldHow to Survive as a Data Architect in a Polyglot Database World
How to Survive as a Data Architect in a Polyglot Database WorldKaren Lopez
 
Extending D365 with Azure
Extending D365 with AzureExtending D365 with Azure
Extending D365 with AzureNelson Johnson
 
Big Data Analytics in the Cloud with Microsoft Azure
Big Data Analytics in the Cloud with Microsoft AzureBig Data Analytics in the Cloud with Microsoft Azure
Big Data Analytics in the Cloud with Microsoft AzureMark Kromer
 
Building Modern Data Platform with Microsoft Azure
Building Modern Data Platform with Microsoft AzureBuilding Modern Data Platform with Microsoft Azure
Building Modern Data Platform with Microsoft AzureDmitry Anoshin
 

Similar to Here are a few ways Couchbase could showcase full-text search capabilities:- Demonstrate building a simple full-text index on a document field and querying it using the FTS syntax. For example, indexing a product description field and searching for products containing specific keywords. - Show how FTS supports features like stemming, wildcards, proximity search, etc. to make searches more flexible and return better results. - Highlight how FTS indexes can be built on multiple fields to enable cross-field searches. For example, searching across product name and description fields.- Compare performance of FTS queries against non-indexed queries to show the benefits of indexing for search. - If data volume allows, showcase (20)

Steps towards business intelligence
Steps towards business intelligenceSteps towards business intelligence
Steps towards business intelligence
 
Microsoft education for it professionals
Microsoft education for it professionalsMicrosoft education for it professionals
Microsoft education for it professionals
 
Data Modeling in SAP Gateway – maximize performance at all levels
Data Modeling in SAP Gateway – maximize performance at all levelsData Modeling in SAP Gateway – maximize performance at all levels
Data Modeling in SAP Gateway – maximize performance at all levels
 
Mark Simpson - UKOUG23 - Refactoring Monolithic Oracle Database Applications ...
Mark Simpson - UKOUG23 - Refactoring Monolithic Oracle Database Applications ...Mark Simpson - UKOUG23 - Refactoring Monolithic Oracle Database Applications ...
Mark Simpson - UKOUG23 - Refactoring Monolithic Oracle Database Applications ...
 
Enter the World of PowerApps - Canvas vs. Model-Driven Apps
Enter the World of PowerApps - Canvas vs. Model-Driven AppsEnter the World of PowerApps - Canvas vs. Model-Driven Apps
Enter the World of PowerApps - Canvas vs. Model-Driven Apps
 
Software architecture patterns
Software architecture patternsSoftware architecture patterns
Software architecture patterns
 
Modern Business Intelligence and Advanced Analytics
Modern Business Intelligence and Advanced AnalyticsModern Business Intelligence and Advanced Analytics
Modern Business Intelligence and Advanced Analytics
 
SPS Vancouver 2018 - What is CDM and CDS
SPS Vancouver 2018 - What is CDM and CDSSPS Vancouver 2018 - What is CDM and CDS
SPS Vancouver 2018 - What is CDM and CDS
 
Symphony Driver Essay
Symphony Driver EssaySymphony Driver Essay
Symphony Driver Essay
 
Dax & sql in power bi
Dax & sql in power biDax & sql in power bi
Dax & sql in power bi
 
DBT ELT approach for Advanced Analytics.pptx
DBT ELT approach for Advanced Analytics.pptxDBT ELT approach for Advanced Analytics.pptx
DBT ELT approach for Advanced Analytics.pptx
 
SQL to NoSQL: Top 6 Questions
SQL to NoSQL: Top 6 QuestionsSQL to NoSQL: Top 6 Questions
SQL to NoSQL: Top 6 Questions
 
Democratization of Data @Indix
Democratization of Data @IndixDemocratization of Data @Indix
Democratization of Data @Indix
 
Microsoft cloud big data strategy
Microsoft cloud big data strategyMicrosoft cloud big data strategy
Microsoft cloud big data strategy
 
Tableau Seattle BI Event How Tableau Changed My Life
Tableau Seattle BI Event How Tableau Changed My LifeTableau Seattle BI Event How Tableau Changed My Life
Tableau Seattle BI Event How Tableau Changed My Life
 
How to Survive as a Data Architect in a Polyglot Database World
How to Survive as a Data Architect in a Polyglot Database WorldHow to Survive as a Data Architect in a Polyglot Database World
How to Survive as a Data Architect in a Polyglot Database World
 
Deep architectural competency for deploying azure solutions
Deep architectural competency for deploying azure solutionsDeep architectural competency for deploying azure solutions
Deep architectural competency for deploying azure solutions
 
Extending D365 with Azure
Extending D365 with AzureExtending D365 with Azure
Extending D365 with Azure
 
Big Data Analytics in the Cloud with Microsoft Azure
Big Data Analytics in the Cloud with Microsoft AzureBig Data Analytics in the Cloud with Microsoft Azure
Big Data Analytics in the Cloud with Microsoft Azure
 
Building Modern Data Platform with Microsoft Azure
Building Modern Data Platform with Microsoft AzureBuilding Modern Data Platform with Microsoft Azure
Building Modern Data Platform with Microsoft Azure
 

More from DATAVERSITY

Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...
Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...
Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...DATAVERSITY
 
Data at the Speed of Business with Data Mastering and Governance
Data at the Speed of Business with Data Mastering and GovernanceData at the Speed of Business with Data Mastering and Governance
Data at the Speed of Business with Data Mastering and GovernanceDATAVERSITY
 
Exploring Levels of Data Literacy
Exploring Levels of Data LiteracyExploring Levels of Data Literacy
Exploring Levels of Data LiteracyDATAVERSITY
 
Make Data Work for You
Make Data Work for YouMake Data Work for You
Make Data Work for YouDATAVERSITY
 
Data Catalogs Are the Answer – What Is the Question?
Data Catalogs Are the Answer – What Is the Question?Data Catalogs Are the Answer – What Is the Question?
Data Catalogs Are the Answer – What Is the Question?DATAVERSITY
 
Data Modeling Fundamentals
Data Modeling FundamentalsData Modeling Fundamentals
Data Modeling FundamentalsDATAVERSITY
 
Showing ROI for Your Analytic Project
Showing ROI for Your Analytic ProjectShowing ROI for Your Analytic Project
Showing ROI for Your Analytic ProjectDATAVERSITY
 
How a Semantic Layer Makes Data Mesh Work at Scale
How a Semantic Layer Makes  Data Mesh Work at ScaleHow a Semantic Layer Makes  Data Mesh Work at Scale
How a Semantic Layer Makes Data Mesh Work at ScaleDATAVERSITY
 
Is Enterprise Data Literacy Possible?
Is Enterprise Data Literacy Possible?Is Enterprise Data Literacy Possible?
Is Enterprise Data Literacy Possible?DATAVERSITY
 
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...DATAVERSITY
 
Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?DATAVERSITY
 
Data Governance Trends - A Look Backwards and Forwards
Data Governance Trends - A Look Backwards and ForwardsData Governance Trends - A Look Backwards and Forwards
Data Governance Trends - A Look Backwards and ForwardsDATAVERSITY
 
Data Governance Trends and Best Practices To Implement Today
Data Governance Trends and Best Practices To Implement TodayData Governance Trends and Best Practices To Implement Today
Data Governance Trends and Best Practices To Implement TodayDATAVERSITY
 
2023 Trends in Enterprise Analytics
2023 Trends in Enterprise Analytics2023 Trends in Enterprise Analytics
2023 Trends in Enterprise AnalyticsDATAVERSITY
 
Data Strategy Best Practices
Data Strategy Best PracticesData Strategy Best Practices
Data Strategy Best PracticesDATAVERSITY
 
Who Should Own Data Governance – IT or Business?
Who Should Own Data Governance – IT or Business?Who Should Own Data Governance – IT or Business?
Who Should Own Data Governance – IT or Business?DATAVERSITY
 
Data Management Best Practices
Data Management Best PracticesData Management Best Practices
Data Management Best PracticesDATAVERSITY
 
MLOps – Applying DevOps to Competitive Advantage
MLOps – Applying DevOps to Competitive AdvantageMLOps – Applying DevOps to Competitive Advantage
MLOps – Applying DevOps to Competitive AdvantageDATAVERSITY
 
Keeping the Pulse of Your Data – Why You Need Data Observability to Improve D...
Keeping the Pulse of Your Data – Why You Need Data Observability to Improve D...Keeping the Pulse of Your Data – Why You Need Data Observability to Improve D...
Keeping the Pulse of Your Data – Why You Need Data Observability to Improve D...DATAVERSITY
 
Empowering the Data Driven Business with Modern Business Intelligence
Empowering the Data Driven Business with Modern Business IntelligenceEmpowering the Data Driven Business with Modern Business Intelligence
Empowering the Data Driven Business with Modern Business IntelligenceDATAVERSITY
 

More from DATAVERSITY (20)

Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...
Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...
Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...
 
Data at the Speed of Business with Data Mastering and Governance
Data at the Speed of Business with Data Mastering and GovernanceData at the Speed of Business with Data Mastering and Governance
Data at the Speed of Business with Data Mastering and Governance
 
Exploring Levels of Data Literacy
Exploring Levels of Data LiteracyExploring Levels of Data Literacy
Exploring Levels of Data Literacy
 
Make Data Work for You
Make Data Work for YouMake Data Work for You
Make Data Work for You
 
Data Catalogs Are the Answer – What Is the Question?
Data Catalogs Are the Answer – What Is the Question?Data Catalogs Are the Answer – What Is the Question?
Data Catalogs Are the Answer – What Is the Question?
 
Data Modeling Fundamentals
Data Modeling FundamentalsData Modeling Fundamentals
Data Modeling Fundamentals
 
Showing ROI for Your Analytic Project
Showing ROI for Your Analytic ProjectShowing ROI for Your Analytic Project
Showing ROI for Your Analytic Project
 
How a Semantic Layer Makes Data Mesh Work at Scale
How a Semantic Layer Makes  Data Mesh Work at ScaleHow a Semantic Layer Makes  Data Mesh Work at Scale
How a Semantic Layer Makes Data Mesh Work at Scale
 
Is Enterprise Data Literacy Possible?
Is Enterprise Data Literacy Possible?Is Enterprise Data Literacy Possible?
Is Enterprise Data Literacy Possible?
 
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
 
Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?
 
Data Governance Trends - A Look Backwards and Forwards
Data Governance Trends - A Look Backwards and ForwardsData Governance Trends - A Look Backwards and Forwards
Data Governance Trends - A Look Backwards and Forwards
 
Data Governance Trends and Best Practices To Implement Today
Data Governance Trends and Best Practices To Implement TodayData Governance Trends and Best Practices To Implement Today
Data Governance Trends and Best Practices To Implement Today
 
2023 Trends in Enterprise Analytics
2023 Trends in Enterprise Analytics2023 Trends in Enterprise Analytics
2023 Trends in Enterprise Analytics
 
Data Strategy Best Practices
Data Strategy Best PracticesData Strategy Best Practices
Data Strategy Best Practices
 
Who Should Own Data Governance – IT or Business?
Who Should Own Data Governance – IT or Business?Who Should Own Data Governance – IT or Business?
Who Should Own Data Governance – IT or Business?
 
Data Management Best Practices
Data Management Best PracticesData Management Best Practices
Data Management Best Practices
 
MLOps – Applying DevOps to Competitive Advantage
MLOps – Applying DevOps to Competitive AdvantageMLOps – Applying DevOps to Competitive Advantage
MLOps – Applying DevOps to Competitive Advantage
 
Keeping the Pulse of Your Data – Why You Need Data Observability to Improve D...
Keeping the Pulse of Your Data – Why You Need Data Observability to Improve D...Keeping the Pulse of Your Data – Why You Need Data Observability to Improve D...
Keeping the Pulse of Your Data – Why You Need Data Observability to Improve D...
 
Empowering the Data Driven Business with Modern Business Intelligence
Empowering the Data Driven Business with Modern Business IntelligenceEmpowering the Data Driven Business with Modern Business Intelligence
Empowering the Data Driven Business with Modern Business Intelligence
 

Recently uploaded

专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改yuu sss
 
Defining Constituents, Data Vizzes and Telling a Data Story
Defining Constituents, Data Vizzes and Telling a Data StoryDefining Constituents, Data Vizzes and Telling a Data Story
Defining Constituents, Data Vizzes and Telling a Data StoryJeremy Anderson
 
9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort service
9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort service9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort service
9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort servicejennyeacort
 
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝DelhiRS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhijennyeacort
 
PKS-TGC-1084-630 - Stage 1 Proposal.pptx
PKS-TGC-1084-630 - Stage 1 Proposal.pptxPKS-TGC-1084-630 - Stage 1 Proposal.pptx
PKS-TGC-1084-630 - Stage 1 Proposal.pptxPramod Kumar Srivastava
 
Generative AI for Social Good at Open Data Science East 2024
Generative AI for Social Good at Open Data Science East 2024Generative AI for Social Good at Open Data Science East 2024
Generative AI for Social Good at Open Data Science East 2024Colleen Farrelly
 
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样vhwb25kk
 
Heart Disease Classification Report: A Data Analysis Project
Heart Disease Classification Report: A Data Analysis ProjectHeart Disease Classification Report: A Data Analysis Project
Heart Disease Classification Report: A Data Analysis ProjectBoston Institute of Analytics
 
Data Factory in Microsoft Fabric (MsBIP #82)
Data Factory in Microsoft Fabric (MsBIP #82)Data Factory in Microsoft Fabric (MsBIP #82)
Data Factory in Microsoft Fabric (MsBIP #82)Cathrine Wilhelmsen
 
2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSING
2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSING2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSING
2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSINGmarianagonzalez07
 
ASML's Taxonomy Adventure by Daniel Canter
ASML's Taxonomy Adventure by Daniel CanterASML's Taxonomy Adventure by Daniel Canter
ASML's Taxonomy Adventure by Daniel Cantervoginip
 
毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree
毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree
毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degreeyuu sss
 
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...Jack DiGiovanna
 
Learn How Data Science Changes Our World
Learn How Data Science Changes Our WorldLearn How Data Science Changes Our World
Learn How Data Science Changes Our WorldEduminds Learning
 
Biometric Authentication: The Evolution, Applications, Benefits and Challenge...
Biometric Authentication: The Evolution, Applications, Benefits and Challenge...Biometric Authentication: The Evolution, Applications, Benefits and Challenge...
Biometric Authentication: The Evolution, Applications, Benefits and Challenge...GQ Research
 
From idea to production in a day – Leveraging Azure ML and Streamlit to build...
From idea to production in a day – Leveraging Azure ML and Streamlit to build...From idea to production in a day – Leveraging Azure ML and Streamlit to build...
From idea to production in a day – Leveraging Azure ML and Streamlit to build...Florian Roscheck
 
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一F sss
 
Identifying Appropriate Test Statistics Involving Population Mean
Identifying Appropriate Test Statistics Involving Population MeanIdentifying Appropriate Test Statistics Involving Population Mean
Identifying Appropriate Test Statistics Involving Population MeanMYRABACSAFRA2
 
Predictive Analysis for Loan Default Presentation : Data Analysis Project PPT
Predictive Analysis for Loan Default  Presentation : Data Analysis Project PPTPredictive Analysis for Loan Default  Presentation : Data Analysis Project PPT
Predictive Analysis for Loan Default Presentation : Data Analysis Project PPTBoston Institute of Analytics
 
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDINTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDRafezzaman
 

Recently uploaded (20)

专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
 
Defining Constituents, Data Vizzes and Telling a Data Story
Defining Constituents, Data Vizzes and Telling a Data StoryDefining Constituents, Data Vizzes and Telling a Data Story
Defining Constituents, Data Vizzes and Telling a Data Story
 
9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort service
9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort service9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort service
9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort service
 
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝DelhiRS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
 
PKS-TGC-1084-630 - Stage 1 Proposal.pptx
PKS-TGC-1084-630 - Stage 1 Proposal.pptxPKS-TGC-1084-630 - Stage 1 Proposal.pptx
PKS-TGC-1084-630 - Stage 1 Proposal.pptx
 
Generative AI for Social Good at Open Data Science East 2024
Generative AI for Social Good at Open Data Science East 2024Generative AI for Social Good at Open Data Science East 2024
Generative AI for Social Good at Open Data Science East 2024
 
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
 
Heart Disease Classification Report: A Data Analysis Project
Heart Disease Classification Report: A Data Analysis ProjectHeart Disease Classification Report: A Data Analysis Project
Heart Disease Classification Report: A Data Analysis Project
 
Data Factory in Microsoft Fabric (MsBIP #82)
Data Factory in Microsoft Fabric (MsBIP #82)Data Factory in Microsoft Fabric (MsBIP #82)
Data Factory in Microsoft Fabric (MsBIP #82)
 
2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSING
2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSING2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSING
2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSING
 
ASML's Taxonomy Adventure by Daniel Canter
ASML's Taxonomy Adventure by Daniel CanterASML's Taxonomy Adventure by Daniel Canter
ASML's Taxonomy Adventure by Daniel Canter
 
毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree
毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree
毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree
 
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
 
Learn How Data Science Changes Our World
Learn How Data Science Changes Our WorldLearn How Data Science Changes Our World
Learn How Data Science Changes Our World
 
Biometric Authentication: The Evolution, Applications, Benefits and Challenge...
Biometric Authentication: The Evolution, Applications, Benefits and Challenge...Biometric Authentication: The Evolution, Applications, Benefits and Challenge...
Biometric Authentication: The Evolution, Applications, Benefits and Challenge...
 
From idea to production in a day – Leveraging Azure ML and Streamlit to build...
From idea to production in a day – Leveraging Azure ML and Streamlit to build...From idea to production in a day – Leveraging Azure ML and Streamlit to build...
From idea to production in a day – Leveraging Azure ML and Streamlit to build...
 
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
 
Identifying Appropriate Test Statistics Involving Population Mean
Identifying Appropriate Test Statistics Involving Population MeanIdentifying Appropriate Test Statistics Involving Population Mean
Identifying Appropriate Test Statistics Involving Population Mean
 
Predictive Analysis for Loan Default Presentation : Data Analysis Project PPT
Predictive Analysis for Loan Default  Presentation : Data Analysis Project PPTPredictive Analysis for Loan Default  Presentation : Data Analysis Project PPT
Predictive Analysis for Loan Default Presentation : Data Analysis Project PPT
 
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDINTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
 

Here are a few ways Couchbase could showcase full-text search capabilities:- Demonstrate building a simple full-text index on a document field and querying it using the FTS syntax. For example, indexing a product description field and searching for products containing specific keywords. - Show how FTS supports features like stemming, wildcards, proximity search, etc. to make searches more flexible and return better results. - Highlight how FTS indexes can be built on multiple fields to enable cross-field searches. For example, searching across product name and description fields.- Compare performance of FTS queries against non-indexed queries to show the benefits of indexing for search. - If data volume allows, showcase

  • 1. Copyright Global Data Strategy, Ltd. 2020 Data Architect vs. Data Engineer vs. Data Modeler Donna Burbank Global Data Strategy, Ltd. October 22nd, 2020 Follow on Twitter @donnaburbank @GlobalDataStrat Twitter Event hashtag: #DAStrategies
  • 2. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2019. All rights reserved. Diversity Data Architect vs. Data Engineer vs. Data Modeler
  • 3. Dynamically query data that resides in AWS S3, on-demand and in real-time Focus on development without worrying about synchronizing data between operational and analytical systems Ingest, consolidate, and analyze data from multiple locations NoSQL architecture that enables flexible schema assigned when data is read 2 Data Modeler The data modeler, translates business rules into usable conceptual, logical, and physical models and database designs.
  • 4. Data Engineer Query data in the Analytics cluster using familiar SQL syntax Utilize a fast, scalable, intuitive, database, which speeds up the development life cycle Visualize data stored in the cluster Develop code that utilizes SDKs to access data as needed 3 Data engineers specialize in big data solutions. They generally, work with data lakes, cloud platforms, and data warehouses in the cloud.
  • 5. Architect Run analytical queries at scale with a massively parallel processing (MPP) Maximize performance Integrate data from disparate sources Dynamically scale as needed 4 The data architect needs to have a comprehensive mastery of all the technologies that all other positions have.
  • 6. Confidential and Proprietary. Do not distribute without Couchbase consent. © Couchbase 2020. All rights reserved. 5 HYBRID CLOUD / MULTI-CLOUD STRATEGY Cloud-agnostic application deployment and management platform that treats cloud providers like commodities and enables you to migrate between clouds freely.
  • 8. Customer Journey 7 Primary Needs Considerations Solution Analyst • Ease of use • Compatibility with BI tools Developer • Performance • Faster development life cycle Administrator • Easy cluster management Architect • Performance • ROI • Support data-driven decisions Analyst • Couchbase Analytics service Developer • Couchbase Analytics service Administrator • Couchbase Analytics service Architect • Couchbase Analytics service Analyst • Easily access data • Analyze data • Produce reports Developer • Write code that utilizes SDKs to access cluster data Administrator • Easily manage cluster Architect • Dynamically scale as needed • Maximize performance
  • 9. The following slides illustrate the demo flow for the Couchbase Connect keynote demo - narrative text is solely to convey context, this is not a script! The slides follow the outline detailed here NOTE: Screenshots are for concept illustration only, they are not the actual screens we show in the demo Text in RED represents areas where Ravi could interrupt with a leading question Data Architect, Data Engineer, Data Modeler for Big data projects. Registration https://content.dataversity.net/102220-Data-Architecture-Webinar_Sponsor- Registration-Couchbase.html Review Material https://www.dataversity.net/data-architect-vs-data-modeler-vs-data-engineer/
  • 10. Persona Describe A Data Architect …. Data architects are for large organizations that need vision across all data activities. If the data scientist is on the fast track, the data architect is on the slow track. The data architect needs to have a comprehensive mastery of all the technologies that all other positions have, as well as the personality and skill to work successfully and gracefully with both IT and business people. “It takes a lot of experience to become a data architect. You can’t go to school and graduate and have this level of experience,” said Bowers. A Data Engineer …. Data engineers specialize in big data solutions, but technology and techniques are too new to provide guaranteed success. Ensure new hires are carefully vetted for skills and experience. The data engineer does the same work as the BI engineer, but using big data, which results in an average salary increase of $10,000. Rather than working with on-premise technologies, Data engineers work with data lakes, cloud platforms, and data warehouses in the cloud. “More cutting edge technology makes you more money, even if you just perform the same function for your business,” he said A Data Modeler …. ● You get what you pay for, so hire good data modelers and pay them well. Find an expert hiring firm with experience specifically hiring data modelers. ● A software engineer who is good at Data Modeling is more expensive but delivers the best results. Data modelers work with data architects and DBA designers and developers to model data, translating business rules into usable conceptual, logical, and physical models and database designs. Good data modelers are highly valued by the enterprise and this is one situation where a simple change in title can increase salary — if the modeling skills are there, he said. “A lot of people think they model data well, and they don’t.” Data Modeling is an art, he said, and because it’s such a hard job to do well, modelers get paid well if they do it well. Bowers had warnings for businesses looking to hire a data modeler. “Because everybody claims to be a good data modeler,” it’s important to interview and evaluate thoroughly to ensure that candidates have proven modeling skills. Bad data models make data integration very difficult, and apps based on flawed models can never perform properly, he said. “It’s a huge value add to get a good data modeler.”
  • 11. Data Analyst Easily access data in Analytics cluster Use BI tools to create matrices and reports Create SQL based queries to analyze data Use predictive analytics software with cluster data 1 0
  • 12. Architect Run analytical queries at scale with a massively parallel processing (MPP) Analyze data using independent nodes, isolated from operational workloads . Optimize analytical queries using multi-dimensional scaling Integrate data from disparate sources 1 1
  • 13. Business Analyst Visualize data stored in the cluster Perform trend analysis of business data Query data in the Analytics cluster using SQL syntax Dynamically query data that resides in AWS S3, on-demand 1 2
  • 14. Administrator Easily adapt and manage architecture Scale cluster up and down and respond to node crashes Support workload isolation Simplify operations with analytical and operational workloads in a single platform 1 3
  • 15. USER PERSONA REQUIREMENTS L o r e m i p s u m Lorem ipsum dolor sit amet, consectetur adipiscing elit. Morbi et rutrum felis, eget tristique tortor. Lorem ipsum Lorem ipsum Lorem ipsum Lorem ipsum dolor sit amet, consectetur adipiscing elit. Morbi et rutrum felis, eget tristique tortor. Lorem ipsum Lorem ipsum Lorem ipsum Lorem ipsum dolor sit amet, consectetur adipiscing elit. Morbi et rutrum felis, eget tristique tortor. Lorem ipsum Lorem ipsum Lorem ipsum L o r e m i p s u m L o r e m i p s u m 1 4
  • 16.
  • 17. Introduction Introduce the application concept and goals with slides INTRO narrative on page 3 here Slide to introduce the application requirements at a high level - (not functional reqs) 1 2
  • 18. Briefly show application as “in-progress / in-development” APPLICATION WILL NOT HAVE FTS/EVENTING/TRANSACTIONS/EMBEDDED BI YET Show SDK pages to make it clear there are tons of developer resources: “We used the Spring Data SDK and Java SDK to implement the application, it made getting started a snap!” Lets see the application so far (short overview - not showing the omitted pieces) 3 4
  • 19. N1QL showcase “One of the reasons the application is so easy to build is thanks to N1QL! We just use plain SQL in our code to communicate with Couchbase!” Interrupt - “OK then, show us how easy it is to query JSON using SQL!” Heres the Couchbase Management Console - it has a query editor built right in! See I am using a simple SQL select here - easy right? Interrupt: “Thats great, but does N1QL support SQL constructs like joins?” Yes it does, here we will join across 2 document types in our query - TRY THAT WITH MongoDB! 5 6
  • 20. INDEX ADVISOR showcase “Performance is a big goal of the application, and Couchbase has features to help optimize...” RUN A SLOOOW QUERY: “Here’s another query using N1QL’s simple SQL syntax - this one returns <user profile information for login?>, but it’s not the fastest query in the world…….” Interrupt: “That query is running pretty slow, but its for a CRITICAL FEATURE! what can Couchbase do to help with that?” “JSON doc databases rely on indexing for performance, due to the docs hierarchical schemaless nature - but if you aren’t an expert at indexing Couchbase INDEX ADVISOR can help!” - show running the ADVISOR 7 8
  • 21. INDEX ADVISOR showcase Click CREATE AND BUILD INDEXES: “Couchbase does the work for me! All I have to do is run the advisor, then set the recommended indexes! How easy is that!” “Now when we re-run the query, it’s lightning fast due to the indexes - thanks to Couchbase INDEX ADVISOR!” 9 10
  • 22. USER MANAGEMENT showcase Interrupt - “Ok, lets start with table stakes - USER MANAGEMENT. Every app needs it, and every developer has implemented it, does Couchbase make it better or easier?” Show User Management data in Couchbase UI “Sure thing, as I mentioned in the intro, we expect tons of users, logging in concurrently from all over the world - Couchbase has the scale and efficiency to handle it…..heres a user in Event Sprint - in a relational DB user info is all across multiple tables - in JSON the user is encapsulated in a single doc - making it more efficient to store and easier to query” “...and Event Sprint handles it here in the code” <show N1QL if possible, show whatever makes sense to depict user mgmt>. “..and here’s the final experience in the UI…”. Show the UI. “BUT! Couchbase does so much more than just this user mgmt!............” 11 12
  • 23. FTS showcase Interrupt - “Ok, lets get a little more sophisticated. App users want to find specific things fast, and you have lots of nuanced info about events and talks in the app, how can users find what they’re looking for?” Show Couchbase UI - FTS settings: “Glad you asked! We do want to allow searching in the app, and we also want to auto suggest, as well as prevent duplicate topic submissions. We’ll use CB FTS - Here I’ll enable an FTS index:” Show setting index - so easy! Test the new index to show how it works “We can even test the search directly in the UI!” 13 14
  • 24. FTS showcase Show application code: “Not only is FTS easy to set, it’s just as easy to call from our app” Paste appropriate code into the app to enable search. Show how it’s simple to call using N1QL. Refresh app Show searching events in the application “FTS is built right in to Couchbase, no bolting on Solr or Elastic Search. Another enterprise feature was so easy to add!” 15 16
  • 25. TRANSACTONS showcase Interrupt - “Ok, here’s another one for you. We all know that updating lots of database records at the same time is costly, how do you perform updates across multiple documents without incurring the overhead?” Show application code: “Couchbase offers a TRANSACTIONS feature for just such a case. Lets say we want to transfer credits from one user to another - all we have to do is call the TRANSACTIONS function and the documents are updated with no overhead” Paste appropriate code into the app. Show how it’s simple to call using N1QL. Refresh app In UI, show credits being moved from user a to user b 17 18
  • 26. EVENTING showcase: Interrupt - “So, everyone expects a proactive experience these days, for example users will expect to be notified about activity in the application around their talks, and to understand social interest towards their talks - not have to go looking for it. How can you kick off a social analysis and proactively alert users, even if they arent on the app?” Show Couchbase UI Eventing editor: “Eventing is built for use cases like this, it can call out to any external service based on a change in the data. In this case after a talk, we’ll call a service that searches for social feedback on the talk and emails the info to users - lets say a given talk has completed, we want to alert everyone on the social feedback” Save the script Go to Event Sprint, check “track social media” for a given talk. Click SAVE. A NEW EMAIL ALERT POPS ON SCREEN Open email, it’s the notification! Calling ext srvcs opens many opps for eventing such as: Cascading deletes, Store history of doc changes (fraud detection), event sourcing/logging (fraud detection) 19 20
  • 27. BI showcase Interrupt - “How about measuring the users acitivity - how easy is it to analyze the data, and even add it to the UI?” Show application code: “Since we can use plain SQL, analyzing and visualizing the data is easy!” Paste appropriate code into the app to query data and visualize it in ChartJS visualization library. Show how it’s simple using N1QL. Refresh app Show charts in the app UI 2221
  • 28. S3 showcase Interrupt - “..Thats great for data stored in Couchbase, but what about data stored elsewhere, such as archived data stored in Amazon S3?, can we analyze that too?” CBS UI - Show ANALYTICS feature: “Couchbase include an MPP just for analytics! It makes quick work of analyzing the massive amount of information we expect to collect” Show the analytics query editor “..it leverages a separate engine optimized for analytic queries” 23 24 Show AWS S3 bucket in AWS console “We harvest talk rating data from the event hosts and store it in S3” Show the analytics query editor “..in the query editor, we can quickly create a reference to the external data in S3...now we can query it through Couchbase using SQL!” Show sample query and result
  • 29. BI showcase Interrupt - “How about using a BI tool?” Show Power BI report: “N1QL’s SQL paradigm means you can use any BI tool with Couchbase! Here I’m mapping all the events across the country using a simple query to the database. <optionally mention/show CData driver>. “Lets embed it to the application!” Copy embed code 25
  • 30. BI showcase Show Event Sprint with embedded report: “N1QL’s SQL paradigm makes using BI tools with Couchbase so easy! And embedding is just as easy! In app code, add the embed code….. 2726
  • 31. CI CD showcase - on AWS Interrupt - “Alright, the app looks great, I think it’s ready for prime time! Since you expect tons of users, how do you deploy for scale? Is it just as easy as everything else? And when if you make changes to the app or data, does that mess up an easy deployment?” 28 FLAG Add a new field to the data in Couchbase UI “Sure thing, lets deploy our updated app, and to make it more realworld, I’ll add a new field to the data” - add new field to user profile. 29 Add a new cluster node in Couchbase UI “I’ll even add a new node to the cluster to make sure we can handle the traffic”
  • 32. CI CD showcase 30 DEPLOY APPLICATION TO CLUSTER 31 Show the the application has inherited the new field COUCHBASE SERVER CONSOLE AWS AS NECESSARY
  • 33. CI CD showcase 32 FAILOVER SIMULATION 33 Application stays up, even with a failure in the cluster! COUCHBASE SERVER CONSOLE AWS AS NECESSARY
  • 34. Copyright Global Data Strategy, Ltd. 2020 Data Architect vs. Data Engineer vs. Data Modeler Donna Burbank Global Data Strategy, Ltd. October 22nd, 2020 Follow on Twitter @donnaburbank @GlobalDataStrat Twitter Event hashtag: #DAStrategies
  • 35. Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com Donna Burbank 2 Donna is a recognised industry expert in information management with over 20 years of experience in data strategy, information management, data modeling, metadata management, and enterprise architecture. Her background is multi-faceted across consulting, product development, product management, brand strategy, marketing, and business leadership. She is currently the Managing Director at Global Data Strategy, Ltd., an international information management consulting company that specializes in the alignment of business drivers with data-centric technology. In past roles, she has served in key brand strategy and product management roles at CA Technologies and Embarcadero Technologies for several of the leading data management products in the market. As an active contributor to the data management community, she is a long time DAMA International member, Past President and Advisor to the DAMA Rocky Mountain chapter, and was awarded the Excellence in Data Management Award from DAMA International. Donna is also an analyst at the Boulder BI Train Trust (BBBT) where she provides advice and gains insight on the latest BI and Analytics software in the market. She was on several review committees for the Object Management Group’s for key information management and process modeling notations. She has worked with dozens of Fortune 500 companies worldwide in the Americas, Europe, Asia, and Africa and speaks regularly at industry conferences. She has co-authored two books: Data Modeling for the Business and Data Modeling Made Simple with ERwin Data Modeler and is a regular contributor to industry publications. She can be reached at donna.burbank@globaldatastrategy.com Donna is based in Boulder, Colorado, USA. Follow on Twitter @donnaburbank @GlobalDataStrat Twitter Event hashtag: #DAStrategies
  • 36. Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com DATAVERSITY Data Architecture Strategies • January 23 Emerging Trends in Data Architecture – What’s the Next Big Thing? • February 27 Building a Data Strategy - Practical Steps for Aligning with Business Goals • March 26 Cloud-Based Data Warehousing – What's New and What Stays the Same • April 23 Master Data Management – Aligning Data, Process, and Governance • May 28 Data Governance and Data Architecture – Alignment and Synergies • June 25 Enterprise Architecture vs. Data Architecture • July 22 Best Practices in Metadata Management • August 27 Data Quality Best Practices • September 24 Data Virtualization – Separating Myth from Reality • October 22 Data Architect vs. Data Engineer vs. Data Modeler • December 1 Graph Databases: Practical Use Cases 3 This Year’s Lineup
  • 37. Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com 3 What We’ll Cover Today 4 • The increasing focus on data in today’s organization has increased demand for critical roles such as data architect, data engineer, and data modeler. • But there is often confusion and ambiguity around what these roles entail, and what overlap exists between them. • This webinar will discuss these data-centric roles and their place in the data-driven organization.
  • 38. Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com Audience 5 There exists a great deal of confusion and differing terminology in the data management industry. This webinar has generated a great deal of pre-interest from, at a minimum, two main audiences: Those Hiring Those Looking for Work “How do I get the right mix of skills on my team?” “How do I find someone who understands my business?” “Where are the right people to help us build our data-driven vision?” “How do I position my skills effectively?” “How do I find the right role that fits my strengths and interests?” “What’s the right company to help me grow?”
  • 39. Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com The Role of the Data Professional in the Data-Driven Business • In the current environment of data-driven business, Data Professionals have an opportunity to have a “seat at the table” • Finding new opportunities to leverage data for business benefit • Creating efficiencies & business process optimization • Integrating data from disparate sources for new business insights • Supporting organizational change 6
  • 40. Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com Data Roles are HOT in today’s market … (and the importance of data quality…) 7 Architect Data-centric roles are in high demand, particularly those who can “speak the language” of both business and technology. Often, that role is a data architect.
  • 41. Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com The Role of the Data Architect 8 Technology Business Janus
  • 42. Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com What is in a Name? 9 • There are a number of data-centric roles that are common, and we’ll explore these today: • Data Architect • Data Engineer • Data Modeler • And there are many, many more in common use. These are a subset of title from data professionals in my network: • Database administrator, DBA, Data platform administrator, Data platform architect, Data guru, Data whisperer, Chief Data Officer, Cloud Data Architect, Semantic modeler, Data Strategist, ETL Developer, ELT Developer, Data manager, Data Governance Manager, Head of Data, Data Lead, Data Innovation Lead, Data consultant, Data analyst, etc., etc. • It’s Clear that this is confusing…
  • 43. Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com 3 Architecture vs. Construction • It’s a common analogy to use building architecture as an analogy to data architecture. • When constructing a building, there is a clear distinction between designing a house and building a house. 10 Design Build
  • 44. Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com Architects vs. Engineers vs. Builders 11 • Similarly, there is a clear distinction between architects, engineers, builders who build the house. I work with the owner to understand their needs and draw the diagrams to match their requirements. I work onsite to make sure that the building is structurally sound. I swing the hammer to make sure the house gets built. Architect Engineer Builder
  • 45. Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com 12 • Unfortunately, with data professionals, the distinctions aren’t as obvious. I work with the owner to understand their needs and draw the diagrams to match their requirements. I make sure that the data platform is structurally sound. I write code to ensure working applications and databases. Architect Engineer Builder Architects vs. Engineers vs. Builders
  • 46. Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com 3 Architecture vs. Construction 13 • When constructing a database, there is a clear distinction between designing and building. Design Build
  • 47. Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com 3 Architecture vs. Construction 14 Solution Design Database Design Database Build • This expands to the overall solution architecture as well, i.e. how the various components and platforms fit together.
  • 48. Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com 3 Is “All in One” Possible? 15 • In the construction world, there are contractors who can perform a mix of Design and Build capabilities. • For small projects, this might be the same person. • Is the same true in the data industry?
  • 49. Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com The Data Roles & Skills Spectrum 16 Platform Infrastructure • Server & hardware setup • Cloud platform configuration • Backup and Recovery • Etc. Data-centric Business Vision & Design Business Requirements Data Landscape Vision & Design Data Landscape Execution Database / Data Store Vision & Design Database / Data Store Execution • Business Model Design • P&L Responsibility • Etc. CEO CDO Strategist • Business Capability Models • Business Process Models • Design Thinking • Conceptual Data Model • System Architecture Diagrams • Data Flow Diagrams • New Technology Exploration • Data platform configuration • Data integration • Performance & tuning • Etc. Data Architect Business Analyst Enterprise Architect Data Modeler Data Architect Solution Architect • Data models • Data store selection • Glossary • Semantic layer • Etc. Data Engineer Data Integrator ETL Developer Data Architect Data Modeler Data Engineer • Database creation • Data store implementation • Performance & tuning • Etc. Data Engineer DBA Infrastructure Engineer • There is a wide variety of roles involved in a successful data initiative ⁻ from Business Vision to Platform Infrastructure ⁻ … and everything in-between
  • 50. Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com Data Architect 17 Platform Infrastructure • Server & hardware setup • Cloud platform configuration • Backup and Recovery • Etc. Data-centric Business Vision & Design Business Requirements Data Landscape Vision & Design Data Landscape Execution Database / Data Store Vision & Design Database / Data Store Execution • Business Model Design • P&L Responsibility • Etc. CEO CDO Strategist • Business Capability Models • Business Process Models • Design Thinking • Conceptual Data Model • System Architecture Diagrams • Data Flow Diagrams • New Technology Exploration • Data platform configuration • Data integration • Performance & tuning • Etc. Data Architect Business Analyst Enterprise Architect Data Modeler Data Architect Solution Architect • Data models • Data store selection • Glossary • Semantic layer • Etc. Data Engineer Data Integrator ETL Developer Data Architect Data Modeler Data Engineer • Database creation • Data store implementation • Performance & tuning • Etc. Data Engineer DBA Infrastructure Engineer
  • 51. Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com Data Modeler 18 Platform Infrastructure • Server & hardware setup • Cloud platform configuration • Backup and Recovery • Etc. Data-centric Business Vision & Design Business Requirements Data Landscape Vision & Design Data Landscape Execution Database / Data Store Vision & Design Database / Data Store Execution • Business Model Design • P&L Responsibility • Etc. CEO CDO Strategist • Business Capability Models • Business Process Models • Design Thinking • Conceptual Data Model • System Architecture Diagrams • Data Flow Diagrams • New Technology Exploration • Data platform configuration • Data integration • Performance & tuning • Etc. Data Architect Business Analyst Enterprise Architect Data Modeler Data Architect Solution Architect • Data models • Data store selection • Glossary • Semantic layer • Etc. Data Engineer Data Integrator ETL Developer Data Architect Data Modeler Data Engineer • Database creation • Data store implementation • Performance & tuning • Etc. Data Engineer DBA Infrastructure Engineer
  • 52. Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com Data Engineer 19 Platform Infrastructure • Server & hardware setup • Cloud platform configuration • Backup and Recovery • Etc. Data-centric Business Vision & Design Business Requirements Data Landscape Vision & Design Data Landscape Execution Database / Data Store Vision & Design Database / Data Store Execution • Business Model Design • P&L Responsibility • Etc. CEO CDO Strategist • Business Capability Models • Business Process Models • Design Thinking • Conceptual Data Model • System Architecture Diagrams • Data Flow Diagrams • New Technology Exploration • Data platform configuration • Data integration • Performance & tuning • Etc. Data Architect Business Analyst Enterprise Architect Data Modeler Data Architect Solution Architect • Data models • Data store selection • Glossary • Semantic layer • Etc. Data Engineer Data Integrator ETL Developer Data Architect Data Modeler Data Engineer • Database creation • Data store implementation • Performance & tuning • Etc. Data Engineer DBA Infrastructure Engineer
  • 53. Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com Don’t Be Afraid to Go “Off Course” • Don’t be afraid to take a roll that’s new or unexpected – you never know where it will lead you! 20 Degrees in Economics & English Temp Jobs from Finance to Manufacturing in College DC Economic Think Tank Degree in Computer Science Consultant – Data Mgt Consultant – EMEA Programmer Product Management Product Marketing Consultant – Business Transformation & Data Mgt Managing Director, Global Data Strategy, Ltd What’s Next?
  • 54. Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com Advice for Data Professionals Looking to Expand 21 3 • Build on your strengths • Do you have domain-specific knowledge in Finance, Manufacturing, Health Care, etc? • Are you a good communicator? • Do you love learning new technology? • Are you a “big picture” thinker – can you connect concepts in a coherent, concise way? • Expand your knowledge • What technical areas can you expand? Online learning options abound! • How can you improve your communication? Toastmasters and other groups can help. • Expand your network • Online platforms such as Linkedin • Data-centric organizations such as DAMA (Data Management Professionals Association) • Online conferences and venues (e.g. Dataversity)
  • 55. Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com 3 Summary • There is a great deal of opportunities for data professionals in today’s market • A broad range of skills are needed for a successful data initiative. • Don’t be afraid to broaden skills into other areas • But at the same time, be clear on roles and accountability. Best of luck on your data projects!
  • 56. Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com About Global Data Strategy™, Ltd • Global Data Strategy™ is an international information management consulting company that specializes in the alignment of business drivers with data-centric technology. • Our passion is data, and helping organizations enrich their business opportunities through data and information. • Our core values center around providing solutions that are: • Business-Driven: We put the needs of your business first, before we look at any technology solution. • Clear & Relevant: We provide clear explanations using real-world examples. • Customized & Right-Sized: Our implementations are based on the unique needs of your organization’s size, corporate culture, and geography. • High Quality & Technically Precise: We pride ourselves in excellence of execution, with years of technical expertise in the industry. 23 Data-Driven Business Transformation Business Strategy Aligned With Data Strategy Visit www.globaldatastrategy.com for more information
  • 57. Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com 3 We’re Hiring! 24 Visit https://globaldatastrategy.com/about/careers/ for more info
  • 58. Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com DATAVERSITY Data Architecture Strategies • January 23 Emerging Trends in Data Architecture – What’s the Next Big Thing? • February 27 Building a Data Strategy - Practical Steps for Aligning with Business Goals • March 26 Cloud-Based Data Warehousing – What's New and What Stays the Same • April 23 Master Data Management – Aligning Data, Process, and Governance • May 28 Data Governance and Data Architecture – Alignment and Synergies • June 25 Enterprise Architecture vs. Data Architecture • July 22 Best Practices in Metadata Management • August 27 Data Quality Best Practices – with Nigel Turner • September 24 Data Virtualization – Separating Myth from Reality • October 22 Data Architect vs. Data Engineer vs. Data Modeler • December 1 Graph Databases: Practical Use Cases 25 Join us next month
  • 59. Global Data Strategy, Ltd. 2020 www.globaldatastrategy.com Questions? 26 • Thoughts? Ideas?