GIS Data Administration (CPT Demos) 37th Edition

A variety of data management and deployment architecture strategies are available today to improve data access and dissemination throughout the rapidly expanding GIS user community. The volume of data you must sort through each day is growing exponentially. How you manage, organize, and control these data resources is critical to system performance and scalability.

This section will first show how to modify the CPT Platform Capacity Calculator workflow configuration to demonstrate the performance impact your data source format selections. Finally, this section will demonstrate how to configure the CPT for an Imagery workflow.
 * Vector data formats
 * Imagery data formats
 * CPT Calculator imagery configuration
 * CPT Design imagery configuration

Modifying the CPT Platform Capacity Calculator workflow configuration
The CPT Platform Capacity Calculator is a simple tool for evaluating selected platform capacity. The default tool, located at the bottom of the CPT Hardware tab, includes a variety of standard workflows that demonstrate platform capacity. For analysis and reporting purposes, you may want to change the default list of sample workflows and include those workflows you are evaluating in your own design environment. This section describes how you can change the Platform Capacity Calculator workflow samples to a custom set of workflows for demonstration purposes.

ArcGIS for Server mapping service data source performance comparison
The CPT provides six data source format selections for vector workflows. These selections include SDE_DBMS, Small File GDB, Large File GDB, Small ShapeFile, Medium Shapefile, and Large Shapefile. The CPT Platform Capacity Calculator default configuration includes a total of 5 workflows.

Figure A-5.2 shows the location of the selected workflows displayed on the Platform Capacity Calculator. These workflows are located in column A directly behind the Platform Capacity chart. To access these workflows, use your mouse to select and drag the Platform Capacity chart to a location below the workflow selection list. The workflow selection list is a group of white cells in column A below the platform selection cell, normally located behind the Platform Capacity chart.

Adjusting the workflow display on the CPT Platform Calculator:
 * Select and slide the Platform Capacity chart below the workflow selection list.
 * Select the desired workflow list.
 * Dropdown list shows available workflow selections from the CPT Workflow tab.
 * Medium complexity workflow must be selected for a proper analysis and display.
 * Workflow name displayed on the Platform Capacity graph is shown in column B.
 * You can expand the number of workflows included in the list by using the copy row and insert copied cells commands.
 * You can reduce the number of workflow included in the list by selecting a row and using the delete command.
 * Complete your desired workflow selection in column A.

"Warning: Make sure to select a workflow with Medium complexity."

 Figure A-5.3 shows where you can select the data source format for each workflow. The data source for each workflow can be selected in column I (same row as the selected workflow). For this example, the AGS103 REST 2D V Med 100%Dyn 13x7 PNG24 workflow was selected to demonstrate variation in performance between the available GIS vector data source selections. There are six different vector data source formats included in the CPT, so a total of six workflow rows were included in the demonstration. A separate data source was selected for each workflow in column I.

Once the workflows and data source selections are made, you can replace the Platform Capacity chart over the workflow selection list for the final analysis and display. When you select a platform configuration in column A, the Platform Capacity chart will show a peak platform throughput range for each of the selected workflows. The Platform Capacity chart shows single platform tier 80 percent throughput estimates for heavy, medium, and light complexity workflow configurations.

 Figure A-5.4 shows the modified custom Platform Capacity Calculator results. Selected platform configuration is the Xeon E5-2637v3 4 core (1 chip) 3500 MHz server. AGS103 REST 2D V Med 100%Dyn 13x7 PNG24 peak throughput varies from 14,933 TPH to 167,800 TPH depending on the display complexity and the selected data source.

Review final display. 
 * Workflow recipe and data source are displayed for each result on the Y-axis.
 * Heavy, medium, and light single platform tier capacity is shown for each workflow based on estimated 80 percent peak throughput.

ArcGIS for Server Imagery service data source performance comparison
The CPT provides seven file based data source format selections for Imagery workflows (excluding SDE DBMS and Image Cache). These selections include TIFF uncompressed, TIFFLZW compression, TIFFJPG compression, JPG2000, MRSID, ECW, and IMG ERDAS. The CPT Platform Capacity Calculator workflow configuration can be adjusted to compare selected platform throughput capacity for the seven Imagery workflows.

Figure A-5.5 provides a view of the CPT Platform Capacity Calculator configured to show performance of the seven (7) available Imagery data source formats. The AGS103 Imagery MosaicDS 2D R Med 100%Dyn 13x7 JPEG recipe is used to represent the imagery workflow. The platform selection is the Xeon E5-2637v3 4-core (1 chip) 3500 MHz server configuration. The platform capacity output ranges from 11,733 TPH to 201,200 TPH based on selected data source and heavy to light workflow complexity.

Procedure for adjusting the custom workflow display on the CPT Platform Capacity Calculator.
 * Select and slide the Platform Capacity chart below the workflow selection list.
 * Select the desired workflow list (AGS103 Imagery MosaicDS 2D R Med 100%Dyn 13x7 JPEG).
 * Expand the workflow list by using the copy row and insert copied cells commands.
 * Complete your desired workflow selection in column A (seven rows with same imagery workflow)

"Warning: Make sure to select a workflow with Medium complexity."


 * Select the data source for each workflow in column I.
 * Replace the Platform Capacity chart over the workflow selection list.

Review the final display. 
 * The workflow recipe and data source are displayed for each result on the Y axis.
 * Heavy, medium, and Light platform capacity is shown for each workflow.

Selecting an imagery workflow on the CPT Calculator tab
Figure A-5.6 shows how to select an Imagery software pattern on the CPT Calculator tab.
 * Select the desired imagery software in column E:F.

"Tip: Cells with invalid selections will show in red."
 * Imagery, Density, Platform Architecture, and Data Source have unique selection lists and will show red if the selection is invalid.

"Warning: New selections must be made in all red cells to configure a valid workflow."

 Figure A-5.7 shows the Imagery dataset search engine selection. Select the imagery dataset search engine (MosaicDS or RasterDS) that will be used for workflow imagery data access.

 Figure A-5.8 shows the Density/Portal selection. For all imagery workflows the Density selection must be Raster Image or RPortal.

Workflows published on Server and registered through a Portal will use the RPortal setting. The Portal selection will increase the Web load to accommodate WebMap access for Portal services associated with the registered workflows.

A separate PortalShare workflow software selection will be used to identify Portal data sharing and collaboration services for user workflows that do not consume registered services.

 Figure A-5.9 shows where to identify the mosaic dataset location. Select the location of the mosaic dataset (DBMS or FGDB).

 Figure A-5.10 shows the imagery data source format selection. The list of available imagery data formats are provided as a dropdown menu when you select an imagery workflow. Select the data source format planned for the imagery workflow.

"Warning: The imagery data format can have a significant impact on platform capacity and display performance."

Once the imagery workflow configuration is complete, the Calculator completes the workflow sizing analysis and shows the resulting platform solution. You can then include the configured imagery workflow in your project workflows on the CPT Workflow tab for access when completing your design. 

Selecting an imagery workflow on the CPT Design tab
Figure A1-5.11 shows the CPT Design tab Imagery workflow selection, highlighting the software configuration cells unique for an imagery workflow.
 * Select the imagery workflow in the proper user location in column B. Imagery workflows must include “Imagery” as the second word in the primary workflow name.
 * Imagery workflows have a unique data source format selection list (column R) and unique Mosaic DS (MDS) location selection (column O) in System Configuration (column R).
 * The unique cell values will show red to identify invalid selections.

"Warning: New selections must be made in all red cells to configure a valid workflow."

 Figure A-5.12 shows the CPT Design imagery data source format selection. The list of available imagery data formats are provided as a dropdown menu when you select an imagery workflow. Select the data source format planned for the imagery workflow.

"Warning: The imagery data format can have a significant impact on platform capacity and display performance."

 Figure A-5.13 shows the Imagery workflow mosaic dataset host geodatabase platform selection. The SDE/MDS selection in the CPT Design Software Configuration Module identifies the location for each workflow mosaic dataset. Proper selections are either an SDE Geodatabase platform (DBMS) or a file geodatabase (FGDB).

 Once you have configured the imagery workflow, you can view the design solution in Figure A-5.14. In this configuration, the GIS server platform is an E5-2637v3 4 core (1 chip) 3500 MHz server configuration hosting the AGS103 REST 2D V Med 100%Dyn 13x7 PNG24 workflow accessing a TIFF imagery data source. System loads are 100,000 TPH. Two GIS Server machines are supporting these loads at a server utilization of 48.3 percent. Mosaic dataset is hosted in an SDE Geodatabase deployed on a FGDB. Peak throughput loads for this workflow deployed on this server configuration is 207,000 TPH. 

CPT Capacity Planning videos
Chapter 5 Capacity Planning Video will show how to reconfigure the CPT Platform Capacity Calculator to evaluate selected workflow performance.

Page Footer Specific license terms for this content System Design Strategies 26th edition - An Esri ® Technical Reference  Document • 2009 (final PDF release)