The City of Markham's Development Application Viewer (MappIT) provides the public with development application information with the intent to increase transparency and reduce the number of inquiries received by staff directly. As the primary ETL solution on this project, FME workbenches are employed to extract data from the city's Customer Relationship Management (CRM) solution, perform data cleanup and sanitization activities, integrate with key spatial datasets in the city's Data Warehouse and populate FeatureLayers in the city's cloud GIS environment (ArcGIS Online). With nightly processing, city residents and the planning community are provided with a modern self-serve, near real-time resource for inquiry and review of all city development activities.

1. AMANDA
+ FME
+ AGOL
MappiT
=

2. Presenters
The
Peak
of
Data
Integration
20
23
www.linkedin.com/in/
greg-czajko-bb8a7713
gczajko@markham.ca
GIS Analyst
City of Markham
GISP, Lean(Greenbelt)

3. The
Peak
of
Data
Integration
20
23
So, what happened?

4. The
Peak
of
Data
Integration
20
23
“You’e got 3 months to create a
Database driven, public facing
mapping web portal… GO!”

5. 5
338,503
Population
10,167
Businesses
2.3%
Employment
Growth
178,274
Jobs

6. The
Peak
of
Data
Integration
20
23
Canada’s Second Largest Tech Hub
”Highest concentration of tech firms per 1,000
residents.”
Markham is home to
Canada’s largest
semiconductor cluster.
Global leaders in
semiconductor chips
include: AMD,
Qualcomm, Creation
Technologies, Vexos, ITL
Circuits, SMTC, Invotek,
Astera Labs and
Markham’s automotive
sector
400+ businesses
Leading auto employers:
GM, Honda Canada,
Hyundai, Mitsubishi,
Multimatic, Magna and
Tesla.

7. The
Peak
of
Data
Integration
20
23
Markham finalist in IDC
Government Insigths’
6th Annual Smart Cities
North America Awards
Markham receives WCCD
Platinum-Level ISO Data
Certification for fourth consecutive
year
Markham wins Smart
Cities North America
Award for AI Pilot Project
to detect potholes
Markham‘s COVID-19
Virtual Assistant continues
to keep community safe
Markham recognized as an
ICF Global SMART21
community for third
consecurity year
2021 2022 2023 2024

8. The
Peak
of
Data
Integration
20
23
Business Case
• Public web mapping interface enabling “members of the public
[to] look up various development applications and tree removal
permits and their status.”
• The data source is Granicus AMANDA (Oracle DB)
• Rapid Application Development methodology is required to
meet the 3 month go-live deadline imposed by Government
Funding requirements.
• Streamline Developments Approvals Fund (SDAF)
• “$45 million fund… to help large urban municipalities identify efficiencies and streamline processes, such as
development approvals, with the goal of building more homes faster to address the housing supply crisis.“

9. The
Peak
of
Data
Integration
20
23
The Challenge
The Challenge

10. The
Peak
of
Data
Integration
20
23
The Challenge
EXTRACT
Harvest data from
AMANDA Oracle
DB
Filter for Dates
and Types
TRANSFORM
Create Point
Features for
mapping
Convert Dates
Translate Codes
to Descriptions
Format
Documents +
Attachments
Extract AMANDA
Infocodes
BUSINESS
RULES
Obfuscate PII
Remove specific
records and fields
Identify ALL /
ACTIVE
LOAD
Write Feature
Classes to ArcGIS
Online
Copy documents
+ attachments to
FileServer
REPORTS
Quality Assurance
Report
Business
Intelligence
Report

11. The
Peak
of
Data
Integration
20
23
“You may use this slide option to include a
quote. Place the quote here, and then include
the first name, last name, job title, and
company name below”.
First Name Last Name
Job Title, Company Name
A quote from
the
customer would be
amazing

12. The
Peak
of
Data
Integration
20
23
How did we do it?

13. The
Peak
of
Data
Integration
20
23
Granicus AMANDA
● Hosted Oracle DB with a Web user interface
● Stored Procedures for extraction
● Extended information stored in INFOCDES
“Hundreds of government agencies trust Amanda to
digitize and streamline critical functions — from building
construction and inspection to planning and zoning to
business licensing and registration.”

14. The
Peak
of
Data
Integration
20
23
EXTRACT TRANSFORM
BUSINESS
RULES LOAD REPORTS

15. The
Peak
of
Data
Integration
20
23
EXTRACT TRANSFORM
BUSINESS
RULES LOAD REPORTS
TRUNC("INDATE") >= TO_DATE('01/JAN/2020','dd/mon/yyyy')
and "FOLDERTYPE" in ('CNDO','CSNT','DEEM','MNV','MZO','PLAN','PTLT','SALT','SPC','TREE')

16. The
Peak
of
Data
Integration
20
23
EXTRACT TRANSFORM BUSINESS
RULES LOAD REPORTS
• PROPERTY – address, parcelID
• FOLDER STATUS – New, Registered, Application etc
• SUBCODE & WORKCODE – Conditional Permit Investigation etc

17. The
Peak
of
Data
Integration
20
23
EXTRACT TRANSFORM BUSINESS
RULES LOAD REPORTS

18. The
Peak
of
Data
Integration
20
23
EXTRACT TRANSFORM BUSINESS
RULES LOAD REPORTS
• PROCESS – Approved, Completed etc
• CONTACTS / PEOPLE – Name, email etc
• ATTACHMENTS – Title, Filename etc
• INFOCODES – Ward, Planner, District etc

19. The
Peak
of
Data
Integration
20
23
EXTRACT TRANSFORM BUSINESS
RULES LOAD REPORTS

20. The
Peak
of
Data
Integration
20
23
EXTRACT TRANSFORM
BUSINESS
RULES LOAD REPORTS

21. The
Peak
of
Data
Integration
20
23
EXTRACT TRANSFORM
BUSINESS
RULES
LOAD REPORTS
XCOPY "@Value(DOSPATH)"
"[server]data$docs" /v /c /y
FIL
E
+ WE
B
(url)

22. The
Peak
of
Data
Integration
20
23
EXTRACT TRANSFORM
BUSINESS
RULES LOAD REPORTS
• Jobs – for tracking of individual scheduled jobs
• Documents + Attachments – for tracking of
attachments copied to FileServer
• Reports – Quality Assurance Report and
Business Intelligence Report

23. The
Peak
of
Data
Integration
20
23
ESRI ArcGIS Online Dashboard technology was chosen as the framework
• Rich selection of highly capable widgets for Data Vis + BI
• URL parameters used to share session values between dashboards
• Hosted Feature Layer - all AMANDA applications (folders) are
converted to a spatial point feature
• Web Maps used to stylize application symbology
• Tables for storage of non-spatial data eg. Contacts, Process etc
“ArcGIS Online is a cloud-based mapping and analysis solution.
Use it to make maps, to analyze data, and to share and collaborate.

24. The
Peak
of
Data
Integration
20
23
contacts
processes
attachments

25. The
Peak
of
Data
Integration
20
23
Key Benefits
&
What’s Next?

26. The
Peak
of
Data
Integration
20
23
Reduction in calls to
Planning Staff for
Application status of an
Application

27. The
Peak
of
Data
Integration
20
23
ESRI ArcGIS Online
Dashboard mobile
view
Migrate FME Desktop
(Form) to FME Flow
(Server)
PII - Personally
Identifiable
Information
Redact or Obfuscate

28. ThankYou!
gczajko@markham.ca