Comp Data Upload

The Comp Data Upload utility enables data service exports to be mapped and uploaded to the StartDeck database. This spreadsheet based tool is available in the StartDeck template library. Simply copy the utility to your personal or team template library, create maps for your data services, then copy the template to your project folder where it can be used as often as needed. 

1. Copy the Comp Data Upload utility from the StartDeck Template Library
2. Create Data Maps for your Export Sources
3. Run Comp Data Upload from the Projects Page
    

Prework: Map Your Data Export to the StartDeck Database

If you are working in a team environment, you'll want to do your mapping work on the template so that all team members have access to the data maps. 

Start by making a copy of the map sheet. The sheet name is "Data Map: [Copy & Name]".  You can create as many data maps as needed. 

Important: Map sheet names must begin with "Data Map:" For example, "Data Map: NorthStar" 

The blank (unmapped) data map sheet looks like this: 

Row 1 is reserved for the source data field names. Simply copy and paste the header row from the source data export sheet. Select cell A1 and paste.

Row 2 contains a list of StartDeck database fields (358 as of this writing). Select the StartDeck field that best matches the source field. The easiest way to find fields is to start typing the field name. See tips below. 

Row 3 displays the mapping progress as each field is mapped. (Spoiler! This can be a tedious process, depending on the number of fields to be mapped.) 

Row 5 will display a field description for the selected field in row 2.

Row 7 is optional but highly recommended. Copy and paste a sample record for reference during the mapping process. 

Rules

• All fields must be mapped. Select "Ignore" to skip a field.
• For fields that do not directly map to StartDeck, or map poorly, use "Unmapped Imported Fields". All fields with this map label will be added to a catch-all bucket and uploaded as part of the record. Here's an example of unmapped fields added to the catch-all bucket:
  Asking Price: 2850000
  Sale Type: Investment
  Buyers Broker Company: RF Real Estate
  Listing Broker Company: Smith & Associates
  Market: Salinas, CA
  Submarket Name: Elkhorn/Pajaro
  All-Inclusive: No
  All-Suites: No
  Amenities: 24 Hour Access, Walking/Biking Trails, Storage Space, Window Coverings, Public Transportation
  Assessed Improved: 201458
  Assessed Land: 22661

Note that data in the "Unmapped Imported Fields" bucket is searchable using the Keywords search feature. For example, searching by keyword  "Elkhorn" would return the above record. 

Tips

• To find matching fields (row 2), start by typing the field name of the source row - this will automatically sort the list. If that doesn't yield results, try other similar names. You can also filter the list by entering part of a field name, like "rate" or "ratio".
• Type "$" for unit price fields, like "$/Sq Ft GBA" (also, use "Price")
• Type "Sq Ft" for area fields, like "Land Sq Ft" and "1-BR Avg Sq Ft"
• Type "1" to show all 1-BR multifamily fields. Likewise, "Studio", "2", "3" and "4" for additional multifamily types.
• StartDeck uses many mutli-select checkbox fields for several database fields to speed manual data entry and provide consistency. These fields require a second mapping step completed under Step 3, Validation. For example, "Sale Status" maps to "Record Type" which requires a specific entries, which are defined during the validation process, discussed below.
• Make bulk edits to the Source Data sheet. For example, if ratios and rates are whole numbers, convert to decimal values on the Source Data sheet. (We have a utility for that on the sidebar: Utilities > Convert Selected Numbers to %)

Uploading Data

Once maps are created, uploading dozens, even hundreds of records is pretty quick. Start by opening the Upload sidebar (not the StartDeck Tables sidebar) from the Instructions sheet (the first sheet in the workbook) using the Actions menu in cell A1.

Step 1: Copy and paste source data. This is a simple as it sounds, simply copy the data export sheet and paste it to cell A1 in the Source Data sheet.

Step 2: Select and apply the appropriate map. StartDeck will insert the map to row 2. 

Step 3: Validate the multi-select fields. StartDeck will detect fields that are mapped to one of our mutli-select fields and offer to change the source data to a matching entry. The "Record Type" field for example displays in the UI as a multi-select field, only accepts the following fields: 

The corresponding source data field may be named "Sale Status" with various records as "Sold", "Under Contract" or "Escrow" among other options.

The initial mapping process would map Sale Status to "Record Type" and the validation process would map individual records as follows:

Step 4: Capture Unmapped Fields
This step scans each record for data mapped to "Unmapped Imported Fields" and captures the data. 

Step 5: Copy the data to the Data Upload sheet. The organizes the data into an upload ready format. Optionally, final edits can be made to the data. For example if all the records are the same type, the default database view can be added. 

Step 6: Upload! After the upload is complete you will see a message displays the Data Upload ID. 

In the search UI, place the Data Upload ID in the keywords search box to return the uploaded dataset. 

Post Upload Actions

Geocode: If the uploaded data does not have latitude or longitude, add geocodes for each record in the uploaded data set.

1. Select records to be geocoded.
2. Click the geocode button. Latitude and Longitude will be added to records that are missing geocodes. Record with geocodes will not be changed.

It's always a good idea to review bulk geocoded data in map view. We use Google's geocode service, and it can sometimes make a mistake, or if there's something off with the address data, the geocode can be off. Records with incorrect geocodes will usually be way off and easy to spot in map view.

Set the default view: Depending on the number of records uploaded, it may be easiest to import the uploaded data set to an appraisal data sheet where bulk edits can be performed, then bulk upload. When practical, usually when the data set consists of the same property type, we recommend setting the default view on Data Upload sheet, before the step 6, Data Upload, is done. 

Utilities (Comp Data Upload Sidebar > Utilities)

• Check for Duplicate Mapping: It's easy to accidentally map a field more than once. This utility will spot duplicate mapping.
• Divide Numbers by 100: Some data services will report rates and ratios as whole numbers. This utility converts whole numbers to decimal equivalent.
• Concatenate Fields: This utility will combine two or more text fields into a single field. For example street number and address can be combined to "Street Address"
• Combine and Sum Fields: This utility is handy for expense fields. For example, cleaning and painting can be combined and added to "Repairs and Maintenance"