Skip to main content
Interania

Learn How Interana Handles Data Types At Ingest Time

0votes
4updates
89views

Goal

After completing this how-to you will be familiar with how Interana detects and interprets raw JSON event data in terms of Interana's built in data types. You might want to first read the Reference Guide Data Types Reference.

Download This Sample JSON Data File

This file, which I generated using http://www.json-generator.com/, contains an example of (almost) every different type of raw JSON data that Interana can read. There's only one event in here; you should copy it and save it locally as a file called all_data_types.json.

[
  {
    "times": {
      "time": "2015-03-16T07:37:58 +07:00",
      "time2": "Wed Jan 01 2014 00:00:00 GMT-0800 (PST)",
      "millitime": 1487094891000
    },
    "identifiers": {
      "_id": "58a35ba4a2ddb79f40ab0a39",
      "guid": "0d26514b-02e7-4810-a6f2-acdad539f867",
      "name": "Ayala Tillman",
      "email": "ayalatillman@prowaste.com"
    },
    "basictypes": {
      "boolean": true,
      "integer": 39,
      "decimal": 84.1371,
      "dollars": "$2,663.86",
      "string": "brown"
    },
    "expansions": {
      "url": "http://placehold.it/index.html",
      "ip": "208.12.45.12",
      "useragent": "Mozilla/5.0 (iPad; U; CPU OS 3_2_1 like Mac OS X; en-us) AppleWebKit/531.21.10 (KHTML, like Gecko) Mobile/7B405"
    },
    "stringarray": [
      "laborum",
      "minim",
      "laborum",
      "do"
    ],
    "arrayofobjects": [
      {
        "id": 0,
        "name": "Hardin Douglas"
      },
      {
        "id": 1,
        "name": "Graves Weeks"
      },
      {
        "id": 2,
        "name": "Christie Taylor"
      }
    ]
  }
]

Preview The File Using The Ingest Wizard

Go to the URL (within your Interana cluster) https://<cluster_url>/?import to access the Ingest Wizard. On the first screen, browse and select the all_data_types.json file you downloaded above. Then click the Next button at the bottom right of the wizard.

On the next screen, you'll see a tabular view of your data, as interpreted by Interana. So all JSON transformation, data type assignments and expansions will have already taken place and you can preview the resulting data as it will be loaded into Interana.

Caveat: certain data types like Decimals and Time are not represented in the preview as they will be imported into Interana. Instead what you are seeing is the raw storage representation inside the Interana data server. So you'll need to trust that as long as Interana has identified those types, things will be okay once the actual import completes.

If you want to see the raw data (before it is interpreted by Interana) you can click the Manage Transformations button. This will show you an intermediate preview of the data, after transformers have been applied, but before the Interana loading phase.

  • Was this article helpful?