SlideShare a Scribd company logo
1 of 30
Microsoft Data Platform MVP Since
2006
Founder SQL Server Indonesia User
Group Community
About Me
My Name : Kiki Rizki Noviandi
Milis : sqlserver-indo@yahoogroups.com
https://www.facebook.com/groups/sqlserverindonesiahttp://www.kwad5.com
https://mvp.microsoft.com/en-us/PublicProfile/33869?fullName=Kiki%20Rizki%20Noviandi
Agenda
• SSIS Task Overview
• FTP Task
• Script Task
SSIS Task Overview
Overview : SSIS Task
• Tasks are control flow elements that define units of work that are
performed in a package control flow
• SQL Server Integration Services package is made up of one or more
tasks. If the package contains more than one task, they are connected
and sequenced in the control flow by precedence constraints.
• The SSIS Designer, the graphical tool in SQL Server Integration
Services for working with packages, provides the design surface for
creating package control flow, and provides custom editors for
configuring tasks
Type Of Task
Integration Services includes the following types of tasks.
• Data Flow Task
• Data Preparation Tasks
• Workflow Tasks
• SQL Server Tasks
• Scripting Tasks
• FTP Task
• Analysis Services Tasks
• Maintenance Tasks
• Custom Tasks
Add or Delete a Task or a Container in a
Control Flow
Add
• In Solution Explorer, double-click the package to
open it.
• Click the Control Flow tab.
• To open the Toolbox, click Toolbox on the View
menu.
• Expand Control Flow Items and Maintenance
Tasks.
• Drag tasks and containers from the Toolbox to the
design surface of the Control Flow tab.
• Connect a task or container within the package
control flow by dragging its connector to another
component in the control flow
Delete
• In Solution Explorer, double-click the package to
open it. Do one of the following:
• Click the Control Flow tab, right-click the task or
container that you want to remove, and then click
Delete.
• Open Package Explorer. From the Executables
folder, right-click the task or container that you
want to remove, and then click Delete.
• To save the updated package, click Save Selected
Items on the File menu.
Set The Properties of Task Or Container
• In SQL Server Data Tools (SSDT), open the Integration Services project that contains
the package you want.
• In Solution Explorer, double-click the package to open it.
• Click the Control Flow tab.
• On the design surface of the Control Flow tab, right-click the task or container, and
then click Properties.
• In the Properties window, update the property value.
• Optionally, create property expressions to dynamically update the properties of
the task or container. For more information, see Add or Change a Property
Expression.
• To save the updated package, click Save Selected Items on the File menu.
Working With FTP Task
FTP Task
What’s FTP Task
• The FTP task downloads and uploads data files and manages
directories on servers, The FTP task downloads and uploads data files
and manages directories on servers.
• You can use the FTP task for the following purposes
• Copying directories and data files from one directory to another
• Logging in to a source FTP location and copying files or packages to a
destination directory.
• Downloading files from an FTP location and applying transformations to
column data before loading the data into a database.
Predefined FTP Operations
FTP Task Editor (General Page)
• Use the General page of the FTP Task Editor dialog box to specify the
FTP connection manager that connects to the FTP server that the task
communicates with. You can also name and describe the FTP task
Option
• FtpConnection
Select an existing FTP connection manager,
or click <New connection...> to create a
connection manager
• StopOnFailure
Indicate whether the FTP task terminates if
an FTP operation fails
• Name
Provide a unique name for the FTP task. This
name is used as the label in the task icon
FTP Task Editor (File Transfer Page)
• Use the File Transfer page of the FTP Task Editor dialog box to
configure the FTP operation that the task performs
Local Parameter
IsLocalPathVariable
Indicate whether the local path is stored in a
variable. This property has the options listed in the
following table.
LocalPath
Select an existing File connection manager, or click
<New connection...> to create a connection
manager
FTP Task Editor (File Transfer Page) Cont..
Operation
• Select the FTP operation to
perform. This property has the
options listed in the following
table
FTP Task Editor (File Transfer Page) Cont..
• IsTransferASCII
Indicate whether files transferred to and from the
remote FTP server should be transferred in ASCII
mode
• Remote Parameters
• IsRemotePathVariable = True
RemoteVariable
Select an existing user-defined variable, or click <New
variable...> to create a user-defined variable.
• IsRemotePathVariable = False
RemotePath
Select an existing FTP connection manager, or click
<New connection...> to create a connection manager.
• OverwriteFileAtDestination
Specify whether a file at the destination can be
overwritten.
FTP Connection Manager
• An FTP connection manager enables
a package to connect to a File
Transfer Protocol (FTP) server. The
FTP task that SQL Server Integration
Services includes uses this
connection manager.
• Specify a server name and server port.
• Specify anonymous access, or provide a
user name and a password for basic
authentication.
• Set the time-out, number of retries, and
the amount of data to copy at a time.
• Indicate whether the FTP connection
manager uses passive or active mode.
FTP TASK
• Installing FTP Server
• FTP Task For Data Exchange
Working With Script Task
Script Task
• Provides code to perform functions that are not available in the built-
in tasks and transformations that SQL Server Integration Services
provides.
• Combine functions in one script instead of using multiple tasks and
transformations.
• Use the Script task for work that must be done once in a package (or
once per enumerated object), instead than once per data row
Purposes Of Script Task
Access data by using other
technologies that are not
supported by built-in
connection types.
• For example, a script can use
Active Directory Service
Interfaces (ADSI) to access
and extract user names from
Active Directory.
Create a package-specific
performance counter.
• For example, a script can
create a performance counter
that is updated while a
complex or poorly performing
task runs.
Identify whether specified files
are empty or how many rows
they contain, and then based
on that information affect the
control flow in a package.
• For example, if a file contains
zero rows, the value of a
variable set to 0, and a
precedence constraint that
evaluates the value prevents
a File System task from
copying the file.
You can use the Script task for the following purposes:
Configuring the Script Task in the Script Task
Editor
• General Page of the Script Task
Editor
• On the General page of the Script
Task Editor, you assign a unique
name and a description for the
Script task.
Configuring the Script Task in the Script Task
Editor
• Script Page of the Script Task Editor
• ScriptLanguage, Microsoft Visual Studio Tools for
Applications (VSTA) supports the Microsoft Visual
Basic or Microsoft Visual C# programming languages.
• EntryPoint Property, Specifies the method on
the ScriptMain class in the VSTA project that the
Integration Services runtime calls as the entry point
into the Script task code. The ScriptMain class is the
default class generated by the script templates
• ReadOnlyVariables and ReadWriteVariables, You ou
can enter comma-delimited lists of existing variables
as the values of these properties to make the
variables available for read-only or read/write access
within the Script task code.
Edit Script Button
The Edit Script button launches the VSTA development environment
which you write your custom script
Expressions Page of the Script Task Editor
• On the Expressions page of the Script Task Editor,
you can use expressions to provide values for the
properties of the Script task listed above and for
many other task properties.
Writing and Running the Script that the Task
Uses
• The Script task uses Microsoft Visual Studio Tools for Applications
(VSTA) as the environment in which you write the scripts and the
engine that runs th
• VSTA installed on the computer where the package runs.
• When the package runs, the task loads the script engine and runs the script.
• You can access external .NET assemblies in scripts by adding references to the
assemblies in the project.
Edit Script
Edit Script Button
The Edit Script button launches the VSTA development environment in
which you write your custom script
Edit Script
Edit Script Button
The Edit Script button launches the VSTA development environment in
which you write your custom script
Script TASK
Creating Service Manager API Using Restful API
Creating Script Task Consuming Restful API
Questing ?
Thank You

More Related Content

What's hot

Synchronization
SynchronizationSynchronization
Synchronizationmisra121
 
Software architectural patterns - A Quick Understanding Guide
Software architectural patterns - A Quick Understanding GuideSoftware architectural patterns - A Quick Understanding Guide
Software architectural patterns - A Quick Understanding GuideMohammed Fazuluddin
 
Exception Handling in VB.Net
Exception Handling in VB.NetException Handling in VB.Net
Exception Handling in VB.Netrishisingh190
 
IBM websphere application server types of profiles
IBM websphere application server types of profilesIBM websphere application server types of profiles
IBM websphere application server types of profilesKuldeep Saxena
 
Topic # 12 of outline Configuring Local Services.pptx
Topic # 12 of outline Configuring Local Services.pptxTopic # 12 of outline Configuring Local Services.pptx
Topic # 12 of outline Configuring Local Services.pptxAyeCS11
 
INTRODUCTION TO UML DIAGRAMS
INTRODUCTION TO UML DIAGRAMSINTRODUCTION TO UML DIAGRAMS
INTRODUCTION TO UML DIAGRAMSAshita Agrawal
 
ASP.NET 08 - Data Binding And Representation
ASP.NET 08 - Data Binding And RepresentationASP.NET 08 - Data Binding And Representation
ASP.NET 08 - Data Binding And RepresentationRandy Connolly
 
Active Server Page(ASP)
Active Server Page(ASP)Active Server Page(ASP)
Active Server Page(ASP)Keshab Nath
 

What's hot (20)

Synchronization
SynchronizationSynchronization
Synchronization
 
Sequence diagrams
Sequence diagramsSequence diagrams
Sequence diagrams
 
Oracle SQL Basics
Oracle SQL BasicsOracle SQL Basics
Oracle SQL Basics
 
Software architectural patterns - A Quick Understanding Guide
Software architectural patterns - A Quick Understanding GuideSoftware architectural patterns - A Quick Understanding Guide
Software architectural patterns - A Quick Understanding Guide
 
Arrays
ArraysArrays
Arrays
 
Exception Handling in VB.Net
Exception Handling in VB.NetException Handling in VB.Net
Exception Handling in VB.Net
 
Xml ppt
Xml pptXml ppt
Xml ppt
 
Uml class-diagram
Uml class-diagramUml class-diagram
Uml class-diagram
 
IBM websphere application server types of profiles
IBM websphere application server types of profilesIBM websphere application server types of profiles
IBM websphere application server types of profiles
 
SQL commands
SQL commandsSQL commands
SQL commands
 
RIA - Rich Internet Applications
RIA - Rich Internet ApplicationsRIA - Rich Internet Applications
RIA - Rich Internet Applications
 
Topic # 12 of outline Configuring Local Services.pptx
Topic # 12 of outline Configuring Local Services.pptxTopic # 12 of outline Configuring Local Services.pptx
Topic # 12 of outline Configuring Local Services.pptx
 
XSLT presentation
XSLT presentationXSLT presentation
XSLT presentation
 
INTRODUCTION TO UML DIAGRAMS
INTRODUCTION TO UML DIAGRAMSINTRODUCTION TO UML DIAGRAMS
INTRODUCTION TO UML DIAGRAMS
 
ASP.NET 08 - Data Binding And Representation
ASP.NET 08 - Data Binding And RepresentationASP.NET 08 - Data Binding And Representation
ASP.NET 08 - Data Binding And Representation
 
4. features of .net
4. features of .net4. features of .net
4. features of .net
 
Mail server
Mail serverMail server
Mail server
 
IIS
IISIIS
IIS
 
Asp Architecture
Asp ArchitectureAsp Architecture
Asp Architecture
 
Active Server Page(ASP)
Active Server Page(ASP)Active Server Page(ASP)
Active Server Page(ASP)
 

Similar to Microsoft Data Platform MVP Kiki Rizki Noviandi Shares SSIS Tasks and Scripting Best Practices

UKLUG 2012 - XPages, Beyond the basics
UKLUG 2012 - XPages, Beyond the basicsUKLUG 2012 - XPages, Beyond the basics
UKLUG 2012 - XPages, Beyond the basicsUlrich Krause
 
[DanNotes] XPages - Beyound the Basics
[DanNotes] XPages - Beyound the Basics[DanNotes] XPages - Beyound the Basics
[DanNotes] XPages - Beyound the BasicsUlrich Krause
 
Muledataweave10 161029032456-161119152200
Muledataweave10 161029032456-161119152200Muledataweave10 161029032456-161119152200
Muledataweave10 161029032456-161119152200harika thamishetti
 
Mule dataweave
Mule dataweaveMule dataweave
Mule dataweaveSon Nguyen
 
Azure App Service for Windows Container
Azure App Service for Windows ContainerAzure App Service for Windows Container
Azure App Service for Windows ContainerKrunal Trivedi
 
Office 365 Saturday (Sydney) - SharePoint framework – build integrated user e...
Office 365 Saturday (Sydney) - SharePoint framework – build integrated user e...Office 365 Saturday (Sydney) - SharePoint framework – build integrated user e...
Office 365 Saturday (Sydney) - SharePoint framework – build integrated user e...Anupam Ranku
 
Tech Talk Live on Share Extensibility
Tech Talk Live on Share ExtensibilityTech Talk Live on Share Extensibility
Tech Talk Live on Share ExtensibilityAlfresco Software
 
XPages -Beyond the Basics
XPages -Beyond the BasicsXPages -Beyond the Basics
XPages -Beyond the BasicsUlrich Krause
 
Lightning web components
Lightning web components Lightning web components
Lightning web components Cloud Analogy
 
Integration Monday - BizTalk Migrator Deep Dive
Integration Monday - BizTalk Migrator Deep DiveIntegration Monday - BizTalk Migrator Deep Dive
Integration Monday - BizTalk Migrator Deep DiveBizTalk360
 
Understanding SharePoint Framework Extensions
Understanding SharePoint Framework ExtensionsUnderstanding SharePoint Framework Extensions
Understanding SharePoint Framework ExtensionsBIWUG
 
Windows 2012 R2 Multi Server Management
Windows 2012 R2 Multi Server ManagementWindows 2012 R2 Multi Server Management
Windows 2012 R2 Multi Server ManagementSharkrit JOBBO
 
Bringing DevOps to the Database
Bringing DevOps to the DatabaseBringing DevOps to the Database
Bringing DevOps to the DatabaseMichaela Murray
 
Migrating very large site collections
Migrating very large site collectionsMigrating very large site collections
Migrating very large site collectionskiwiboris
 
Envision IT - Application Lifecycle Management for SharePoint in the Enterprise
Envision IT - Application Lifecycle Management for SharePoint in the EnterpriseEnvision IT - Application Lifecycle Management for SharePoint in the Enterprise
Envision IT - Application Lifecycle Management for SharePoint in the EnterpriseEnvision IT
 
Meetup developing building and_deploying databases with SSDT
Meetup developing building and_deploying databases with SSDTMeetup developing building and_deploying databases with SSDT
Meetup developing building and_deploying databases with SSDTSolidify
 
Migrating Very Large Site Collections (SPSDC)
Migrating Very Large Site Collections (SPSDC)Migrating Very Large Site Collections (SPSDC)
Migrating Very Large Site Collections (SPSDC)kiwiboris
 
Presentation kaushal
Presentation kaushalPresentation kaushal
Presentation kaushalAjay Yadav
 

Similar to Microsoft Data Platform MVP Kiki Rizki Noviandi Shares SSIS Tasks and Scripting Best Practices (20)

Datastage Introduction To Data Warehousing
Datastage Introduction To Data WarehousingDatastage Introduction To Data Warehousing
Datastage Introduction To Data Warehousing
 
UKLUG 2012 - XPages, Beyond the basics
UKLUG 2012 - XPages, Beyond the basicsUKLUG 2012 - XPages, Beyond the basics
UKLUG 2012 - XPages, Beyond the basics
 
[DanNotes] XPages - Beyound the Basics
[DanNotes] XPages - Beyound the Basics[DanNotes] XPages - Beyound the Basics
[DanNotes] XPages - Beyound the Basics
 
Muledataweave10 161029032456-161119152200
Muledataweave10 161029032456-161119152200Muledataweave10 161029032456-161119152200
Muledataweave10 161029032456-161119152200
 
Mule dataweave
Mule dataweaveMule dataweave
Mule dataweave
 
Azure App Service for Windows Container
Azure App Service for Windows ContainerAzure App Service for Windows Container
Azure App Service for Windows Container
 
Office 365 Saturday (Sydney) - SharePoint framework – build integrated user e...
Office 365 Saturday (Sydney) - SharePoint framework – build integrated user e...Office 365 Saturday (Sydney) - SharePoint framework – build integrated user e...
Office 365 Saturday (Sydney) - SharePoint framework – build integrated user e...
 
Tech Talk Live on Share Extensibility
Tech Talk Live on Share ExtensibilityTech Talk Live on Share Extensibility
Tech Talk Live on Share Extensibility
 
XPages -Beyond the Basics
XPages -Beyond the BasicsXPages -Beyond the Basics
XPages -Beyond the Basics
 
Lightning web components
Lightning web components Lightning web components
Lightning web components
 
Integration Monday - BizTalk Migrator Deep Dive
Integration Monday - BizTalk Migrator Deep DiveIntegration Monday - BizTalk Migrator Deep Dive
Integration Monday - BizTalk Migrator Deep Dive
 
Understanding SharePoint Framework Extensions
Understanding SharePoint Framework ExtensionsUnderstanding SharePoint Framework Extensions
Understanding SharePoint Framework Extensions
 
Windows 2012 R2 Multi Server Management
Windows 2012 R2 Multi Server ManagementWindows 2012 R2 Multi Server Management
Windows 2012 R2 Multi Server Management
 
Bringing DevOps to the Database
Bringing DevOps to the DatabaseBringing DevOps to the Database
Bringing DevOps to the Database
 
Migrating very large site collections
Migrating very large site collectionsMigrating very large site collections
Migrating very large site collections
 
2 designer
2 designer2 designer
2 designer
 
Envision IT - Application Lifecycle Management for SharePoint in the Enterprise
Envision IT - Application Lifecycle Management for SharePoint in the EnterpriseEnvision IT - Application Lifecycle Management for SharePoint in the Enterprise
Envision IT - Application Lifecycle Management for SharePoint in the Enterprise
 
Meetup developing building and_deploying databases with SSDT
Meetup developing building and_deploying databases with SSDTMeetup developing building and_deploying databases with SSDT
Meetup developing building and_deploying databases with SSDT
 
Migrating Very Large Site Collections (SPSDC)
Migrating Very Large Site Collections (SPSDC)Migrating Very Large Site Collections (SPSDC)
Migrating Very Large Site Collections (SPSDC)
 
Presentation kaushal
Presentation kaushalPresentation kaushal
Presentation kaushal
 

More from Kiki Noviandi

SSIS: Flow tasks, containers and precedence constraints
SSIS: Flow tasks, containers and precedence constraintsSSIS: Flow tasks, containers and precedence constraints
SSIS: Flow tasks, containers and precedence constraintsKiki Noviandi
 
Developing (KPI) Key Performance Indicators
Developing (KPI) Key Performance IndicatorsDeveloping (KPI) Key Performance Indicators
Developing (KPI) Key Performance IndicatorsKiki Noviandi
 
Sql server master data services
Sql server master data servicesSql server master data services
Sql server master data servicesKiki Noviandi
 
Cyber crime Bani Umar bintaro
Cyber crime   Bani Umar bintaroCyber crime   Bani Umar bintaro
Cyber crime Bani Umar bintaroKiki Noviandi
 
Query and operators optimization
Query and operators optimizationQuery and operators optimization
Query and operators optimizationKiki Noviandi
 
Sql in memory database
Sql in memory databaseSql in memory database
Sql in memory databaseKiki Noviandi
 
Sql performance tools
Sql performance toolsSql performance tools
Sql performance toolsKiki Noviandi
 

More from Kiki Noviandi (10)

Power bi overview
Power bi overview Power bi overview
Power bi overview
 
Ssis event handler
Ssis event handlerSsis event handler
Ssis event handler
 
SSIS: Flow tasks, containers and precedence constraints
SSIS: Flow tasks, containers and precedence constraintsSSIS: Flow tasks, containers and precedence constraints
SSIS: Flow tasks, containers and precedence constraints
 
Developing (KPI) Key Performance Indicators
Developing (KPI) Key Performance IndicatorsDeveloping (KPI) Key Performance Indicators
Developing (KPI) Key Performance Indicators
 
Sql server master data services
Sql server master data servicesSql server master data services
Sql server master data services
 
Cyber crime Bani Umar bintaro
Cyber crime   Bani Umar bintaroCyber crime   Bani Umar bintaro
Cyber crime Bani Umar bintaro
 
Database overview
Database  overviewDatabase  overview
Database overview
 
Query and operators optimization
Query and operators optimizationQuery and operators optimization
Query and operators optimization
 
Sql in memory database
Sql in memory databaseSql in memory database
Sql in memory database
 
Sql performance tools
Sql performance toolsSql performance tools
Sql performance tools
 

Recently uploaded

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
Developing An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilDeveloping An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilV3cube
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...gurkirankumar98700
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 

Recently uploaded (20)

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Developing An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilDeveloping An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of Brazil
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 

Microsoft Data Platform MVP Kiki Rizki Noviandi Shares SSIS Tasks and Scripting Best Practices

  • 1.
  • 2. Microsoft Data Platform MVP Since 2006 Founder SQL Server Indonesia User Group Community About Me My Name : Kiki Rizki Noviandi Milis : sqlserver-indo@yahoogroups.com https://www.facebook.com/groups/sqlserverindonesiahttp://www.kwad5.com https://mvp.microsoft.com/en-us/PublicProfile/33869?fullName=Kiki%20Rizki%20Noviandi
  • 3. Agenda • SSIS Task Overview • FTP Task • Script Task
  • 5. Overview : SSIS Task • Tasks are control flow elements that define units of work that are performed in a package control flow • SQL Server Integration Services package is made up of one or more tasks. If the package contains more than one task, they are connected and sequenced in the control flow by precedence constraints. • The SSIS Designer, the graphical tool in SQL Server Integration Services for working with packages, provides the design surface for creating package control flow, and provides custom editors for configuring tasks
  • 6. Type Of Task Integration Services includes the following types of tasks. • Data Flow Task • Data Preparation Tasks • Workflow Tasks • SQL Server Tasks • Scripting Tasks • FTP Task • Analysis Services Tasks • Maintenance Tasks • Custom Tasks
  • 7. Add or Delete a Task or a Container in a Control Flow Add • In Solution Explorer, double-click the package to open it. • Click the Control Flow tab. • To open the Toolbox, click Toolbox on the View menu. • Expand Control Flow Items and Maintenance Tasks. • Drag tasks and containers from the Toolbox to the design surface of the Control Flow tab. • Connect a task or container within the package control flow by dragging its connector to another component in the control flow Delete • In Solution Explorer, double-click the package to open it. Do one of the following: • Click the Control Flow tab, right-click the task or container that you want to remove, and then click Delete. • Open Package Explorer. From the Executables folder, right-click the task or container that you want to remove, and then click Delete. • To save the updated package, click Save Selected Items on the File menu.
  • 8. Set The Properties of Task Or Container • In SQL Server Data Tools (SSDT), open the Integration Services project that contains the package you want. • In Solution Explorer, double-click the package to open it. • Click the Control Flow tab. • On the design surface of the Control Flow tab, right-click the task or container, and then click Properties. • In the Properties window, update the property value. • Optionally, create property expressions to dynamically update the properties of the task or container. For more information, see Add or Change a Property Expression. • To save the updated package, click Save Selected Items on the File menu.
  • 11. What’s FTP Task • The FTP task downloads and uploads data files and manages directories on servers, The FTP task downloads and uploads data files and manages directories on servers. • You can use the FTP task for the following purposes • Copying directories and data files from one directory to another • Logging in to a source FTP location and copying files or packages to a destination directory. • Downloading files from an FTP location and applying transformations to column data before loading the data into a database.
  • 13. FTP Task Editor (General Page) • Use the General page of the FTP Task Editor dialog box to specify the FTP connection manager that connects to the FTP server that the task communicates with. You can also name and describe the FTP task Option • FtpConnection Select an existing FTP connection manager, or click <New connection...> to create a connection manager • StopOnFailure Indicate whether the FTP task terminates if an FTP operation fails • Name Provide a unique name for the FTP task. This name is used as the label in the task icon
  • 14. FTP Task Editor (File Transfer Page) • Use the File Transfer page of the FTP Task Editor dialog box to configure the FTP operation that the task performs Local Parameter IsLocalPathVariable Indicate whether the local path is stored in a variable. This property has the options listed in the following table. LocalPath Select an existing File connection manager, or click <New connection...> to create a connection manager
  • 15. FTP Task Editor (File Transfer Page) Cont.. Operation • Select the FTP operation to perform. This property has the options listed in the following table
  • 16. FTP Task Editor (File Transfer Page) Cont.. • IsTransferASCII Indicate whether files transferred to and from the remote FTP server should be transferred in ASCII mode • Remote Parameters • IsRemotePathVariable = True RemoteVariable Select an existing user-defined variable, or click <New variable...> to create a user-defined variable. • IsRemotePathVariable = False RemotePath Select an existing FTP connection manager, or click <New connection...> to create a connection manager. • OverwriteFileAtDestination Specify whether a file at the destination can be overwritten.
  • 17. FTP Connection Manager • An FTP connection manager enables a package to connect to a File Transfer Protocol (FTP) server. The FTP task that SQL Server Integration Services includes uses this connection manager. • Specify a server name and server port. • Specify anonymous access, or provide a user name and a password for basic authentication. • Set the time-out, number of retries, and the amount of data to copy at a time. • Indicate whether the FTP connection manager uses passive or active mode.
  • 18. FTP TASK • Installing FTP Server • FTP Task For Data Exchange
  • 20. Script Task • Provides code to perform functions that are not available in the built- in tasks and transformations that SQL Server Integration Services provides. • Combine functions in one script instead of using multiple tasks and transformations. • Use the Script task for work that must be done once in a package (or once per enumerated object), instead than once per data row
  • 21. Purposes Of Script Task Access data by using other technologies that are not supported by built-in connection types. • For example, a script can use Active Directory Service Interfaces (ADSI) to access and extract user names from Active Directory. Create a package-specific performance counter. • For example, a script can create a performance counter that is updated while a complex or poorly performing task runs. Identify whether specified files are empty or how many rows they contain, and then based on that information affect the control flow in a package. • For example, if a file contains zero rows, the value of a variable set to 0, and a precedence constraint that evaluates the value prevents a File System task from copying the file. You can use the Script task for the following purposes:
  • 22. Configuring the Script Task in the Script Task Editor • General Page of the Script Task Editor • On the General page of the Script Task Editor, you assign a unique name and a description for the Script task.
  • 23. Configuring the Script Task in the Script Task Editor • Script Page of the Script Task Editor • ScriptLanguage, Microsoft Visual Studio Tools for Applications (VSTA) supports the Microsoft Visual Basic or Microsoft Visual C# programming languages. • EntryPoint Property, Specifies the method on the ScriptMain class in the VSTA project that the Integration Services runtime calls as the entry point into the Script task code. The ScriptMain class is the default class generated by the script templates • ReadOnlyVariables and ReadWriteVariables, You ou can enter comma-delimited lists of existing variables as the values of these properties to make the variables available for read-only or read/write access within the Script task code. Edit Script Button The Edit Script button launches the VSTA development environment which you write your custom script
  • 24. Expressions Page of the Script Task Editor • On the Expressions page of the Script Task Editor, you can use expressions to provide values for the properties of the Script task listed above and for many other task properties.
  • 25. Writing and Running the Script that the Task Uses • The Script task uses Microsoft Visual Studio Tools for Applications (VSTA) as the environment in which you write the scripts and the engine that runs th • VSTA installed on the computer where the package runs. • When the package runs, the task loads the script engine and runs the script. • You can access external .NET assemblies in scripts by adding references to the assemblies in the project.
  • 26. Edit Script Edit Script Button The Edit Script button launches the VSTA development environment in which you write your custom script
  • 27. Edit Script Edit Script Button The Edit Script button launches the VSTA development environment in which you write your custom script
  • 28. Script TASK Creating Service Manager API Using Restful API Creating Script Task Consuming Restful API