GIS Data Administration (CPT Demos)

Arc19CapacityPlanning0201 release

A variety of data management and deployment architecture strategies are available today to improve data access and dissemination throughout the rapidly expanding GIS user community. The volume of data you must sort through each day is growing exponentially. How you manage, organize, and control these data resources is critical to system performance and scalability.

This section will first show how to modify the CPT Platform Capacity Calculator workflow configuration to demonstrate the performance impact your data source format selections. Finally, this section will demonstrate how to configure the CPT for an Imagery workflow.
 * Vector data formats
 * Imagery data formats
 * CPT Calculator imagery configuration
 * CPT Design imagery configuration

Modifying the CPT Platform Capacity Calculator workflow configuration
The CPT Platform Capacity Calculator is a simple tool for evaluating selected platform capacity. The default tool, located at the bottom of the CPT Hardware tab, includes a variety of standard workflows that demonstrate platform capacity. For analysis and reporting purposes, you may want to change the default list of sample workflows and include those workflows you are evaluating in your own design environment. This section describes how you can change the Platform Capacity Calculator workflow samples to a custom set of workflows for demonstration purposes.

ArcGIS Server mapping service data source performance comparison
The CPT provides six data source format selections for vector workflows. These selections include DB_DBMS, Small File GDB, Large File GDB, Small ShapeFile, Medium Shapefile, and Large Shapefile. The CPT Platform Capacity Calculator default configuration includes a total of 5 workflows.

Figure A-5.2 shows the location of the selected workflows displayed on the Platform Capacity Calculator. These workflows are located in column A directly behind the Platform Capacity chart. To access these workflows, use your mouse to select and drag the Platform Capacity chart to a location below the workflow selection list. The workflow selection list is a group of white cells in column A below the platform selection cell, normally located behind the Platform Capacity chart.

Adjusting the workflow display on the CPT Platform Calculator:
 * Select and slide the Platform Capacity chart below the workflow selection list.
 * Select the desired workflow list.
 * Dropdown list shows available workflow selections from the CPT Workflow tab.
 * Heavy complexity workflow must be selected for a proper analysis and display.
 * Workflow name displayed on the Platform Capacity graph is shown in column B.
 * You can expand the number of workflows included in the list by using the copy row and insert copied cells commands.
 * You can reduce the number of workflow included in the list by selecting a row and using the delete command.
 * Complete your desired workflow selection in column A.

"Warning: Make sure to select a workflow with heavy complexity."

 Figure A-5.3 shows where you can select the data source format for each workflow. The data source for each workflow can be selected in column I (same row as the selected workflow). For this example, the AGS REST 2D V Hvy 100%Dyn 13x7 PNG24 workflow was selected to demonstrate variation in performance between the available GIS vector data source selections. There are six different vector data source formats included in the CPT, so a total of six workflow rows were included in the demonstration. A separate data source was selected for each workflow in column I.

Once the workflows and data source selections are made, you can replace the Platform Capacity chart over the workflow selection list for the final analysis and display. When you select a platform configuration in column A, the Platform Capacity chart will show a peak platform throughput range for each of the selected workflows. The Platform Capacity chart shows single platform tier 80 percent throughput estimates for 2xMedium, heavy, and medium complexity workflow configurations.

 Figure A-5.4 shows the modified custom Platform Capacity Calculator results. Selected platform configuration is the Xeon Gold 5122 4 core (1 chip) 3600 MHz server. AGS REST 2D V 100%Dyn 13x7 PNG24 peak throughput varies from 13,900 TPH to 98,500 TPH depending on the display complexity and the selected data source.

Review final display. 
 * Workflow recipe and data source are displayed for each result on the Y-axis.
 * 2xMedium, heavy, and medium single platform tier capacity is shown for each workflow based on estimated 80 percent peak throughput.

ArcGIS Server Imagery service data source performance comparison
The CPT provides seven file based data source format selections for Imagery workflows (excluding DB DBMS and Image Cache). These selections include TIFF uncompressed, TIFFLZW compression, TIFFJPG compression, JPG2000, MRSID, ECW, and IMG ERDAS. The CPT Platform Capacity Calculator workflow configuration can be adjusted to compare selected platform throughput capacity for the seven Imagery workflows.

Figure A-5.5 provides a view of the CPT Platform Capacity Calculator configured to show performance of the seven (7) available Imagery data source formats. The AGS Imagery MosaicDS 2D R 100%Dyn 19x10 JPEG recipe is used to represent the imagery workflow. The platform selection is the Xeon Gold 5122 4 core (1 chip) 3600 MHz server configuration. The platform capacity output ranges from 9,700 TPH to 103,400 TPH based on selected data source and 2xMedium to Medium workflow complexity.

Procedure for adjusting the custom workflow display on the CPT Platform Capacity Calculator.
 * Select and slide the Platform Capacity chart below the workflow selection list.
 * Select the desired workflow list (AGS Imagery 2D R Hvy 100%Dyn 19x10 JPEG).
 * Expand the workflow list by using the copy row and insert copied cells commands.
 * Complete your desired workflow selection in column A (seven rows with same imagery workflow)

"Warning: Make sure to select a workflow with heavy complexity."


 * Select the data source for each workflow in column I.
 * Replace the Platform Capacity chart over the workflow selection list.

Review the final display. 
 * The workflow recipe and data source are displayed for each result on the Y axis.
 * 2xMedium, heavy, and medium platform capacity is shown for each workflow.

Selecting an imagery workflow on the CPT Calculator tab
Figure A-5.6 shows how to select an Imagery software pattern on the CPT Calculator tab.
 * Select the desired imagery software in column E:F.

"Tip: Cells with invalid selections will show in red."
 * Imagery, Density, Platform Architecture, and Data Source have unique selection lists and will show red if the selection is invalid.

"Warning: New selections must be made in all red cells to configure a valid workflow." 

Figure A-5.7 shows the Density/Portal selection. For all imagery workflows the Density selection must be Raster Image or RPortal.

Workflows published on Server and registered through a Portal will use the RPortal setting. The Portal selection will increase the Web load to accommodate WebMap access for Portal services associated with the registered workflows.

A separate PortalShare workflow software selection will be used to identify Portal data sharing and collaboration services for user workflows that do not consume registered services. 

Figure A-5.8 shows where to identify the mosaic dataset location. Select the location of the mosaic dataset (DBMS or FGDB). 

Figure A-5.9 shows the imagery data source format selection. The list of available imagery data formats is provided as a dropdown menu when you select an imagery workflow. Select the data source format planned for the imagery workflow.

"Warning: The imagery data format can have a significant impact on platform capacity and display performance."

Once the imagery workflow configuration is complete, the Calculator completes the workflow sizing analysis and shows the resulting platform solution. You can then include the configured imagery workflow in your project workflows on the CPT Workflow tab for access when completing your design. 

Selecting an imagery workflow on the CPT Design tab
Figure A1-5.10 shows the CPT Design tab Imagery workflow selection, highlighting the software configuration cells unique for an imagery workflow.
 * Select the imagery workflow in the proper user location in column B. Imagery workflows must include “Imagery” as the second word in the primary workflow name.
 * Imagery workflows have a unique data source format selection list (column R) and unique Mosaic DS (MDS) location selection (column O) in System Configuration (column R).
 * The unique cell values will show red to identify invalid selections.

"Warning: New selections must be made in all red cells to configure a valid workflow." 

Figure A-5.11 shows the CPT Design imagery data source format selection. The list of available imagery data formats is provided as a dropdown menu when you select an imagery workflow. Select the data source format planned for the imagery workflow.

"Warning: The imagery data format can have a significant impact on platform capacity and display performance." 

Figure A-5.12 shows the Imagery workflow mosaic dataset host geodatabase platform selection. The DS/MDS selection in the CPT Design Software Configuration Module identifies the location for each workflow mosaic dataset. Proper selections are either an Enterprise Geodatabase platform (DBMS) or a file geodatabase (FGDB). 

Once you have configured the imagery workflow, you can view the design solution in Figure A-5.13. In this configuration, the GIS server platform is an E5-2637v4 4 core (1 chip) 3500 MHz server configuration hosting the AGS Imagery 2D R Med 100%Dyn 19x10 JPEG workflow accessing a TIFF imagery data source. System loads are 100,000 TPH. Three server machines are supporting these loads with two GIS Server platform utilization of 40.3 percent. Mosaic dataset is hosted in an Enterprise Geodatabase deployed on a DBMS. Peak throughput loads for this workflow deployed on this server configuration is 311,000 TPH. 

CPT Capacity Planning videos
Chapter 5 Capacity Planning Video will show how to reconfigure the CPT Platform Capacity Calculator to evaluate selected workflow performance.

Page Footer Specific license terms for this content System Design Strategies 26th edition - An Esri ® Technical Reference Document • 2009 (final PDF release)