What Are The Supported Input Data Formats

Knowledge Base & Community Wiki

What Are The Supported Input Data Formats

in

This article provides details about the various input data formats supported by VisualizeIT. Please note that at this point in time VisualizeIT only allows import of “Time Series” data into the system as CSV files. Time Series data as you would know consists of multiple records where each record consists of a timestamp including an associated value. Examples of Time Series data that VisualizeIT can consume are as follows:

Web Server Hits Obtain from ELK (Elasticsearch, Logstash, Kibana – http://www.elastic.co) : The format of the Time Series data set is “Unix Epoch, Web Server Hits”. VisualizeIT allows uploading of one set of “Timestamp, Value” into a given Application/Data Dimension at once. This is a sample data set to illustrate the format of data that can be imported from this solution.

UnixTime,Web_Server_Hits

1441562400000,12

1441566000000,130

1441569600000,128

1441573200000,364

Web Server Hits Obtain from Splunk (http://www.splunk.com): The format of the Time Series data set is “Timestamp, Web Server Hits”. VisualizeIT allows uploading of one set of “Timestamp, Value” into a given Application/Data Dimension at once. This is a sample data set to illustrate the format of data that can be imported from this solution.

“_time”,”Web Server Hits”

“2015-09-10T18:00:00.000-0500”,12

“2015-09-10T18:01:00.000-0500”,5

“2015-09-10T18:02:00.000-0500”,3

CPU Utilization obtained from Splunk (http://www.splunk.com) : The format of the Time Series data set is “Timestamp, value, value, value”. VisualizeIT will however required you to chose which value (from the three below) to upload into the system for the given Data Dimension. VisualizeIT allows uploading of only one set of “Timestamp, Value” into a given Application/Data Dimension at once. This is a sample data set to illustrate the format of data that can be imported from this solution.

“_time”,”max(load1)”,”max(load5)”,”max(load15)”

“2015-09-10T18:00:00.000-0500″,”0.160″,”0.690″,”0.900”

“2015-09-10T18:01:00.000-0500″,”0.720″,”0.740″,”0.900”

“2015-09-10T18:02:00.000-0500″,”0.790″,”0.740”,”0.890

Varnish Hits obtained from Sumologic (http://www.sumologic.com) : The format of the Time Series data set is “Timestamp, Value, Value, Value”. VisualizeIT will however required you to chose which value (from the ones on the columns) to upload into the system for the given Data Dimension. VisualizeIT allows uploading of one set of “Timestamp, Value” into a given Application/Data Dimension at once. This is a sample data set to illustrate the format of data that can be imported from this solution.

“_timeslice”,”aragorn”,”gandalf”
“02/01/2016 12:15:00.000 +1000″,”311″,”295”
“02/01/2016 12:20:00.000 +1000″,”448″,”418”
“02/01/2016 12:25:00.000 +1000″,”506″,”525”
“02/01/2016 12:30:00.000 +1000″,”442″,”409”
“02/01/2016 12:35:00.000 +1000″,”596″,”505”
“02/01/2016 12:40:00.000 +1000″,”567″,”600”

Internet Traffic Data obtained in CSV Format: The format of the Time Series data is “Timestamp, Value”. VisualizeIT allows uploading of one set of “Timestamp, Value” into a given Application/Data Dimension at once.

“Time”,”Internettrafficdata”

“2004-11-19 09:30:00”,64554.479

“2004-11-19 10:30:00”,71138.749

“2004-11-19 11:30:00”,77253.266

“2004-11-19 12:30:00”,77340.78

“2004-11-19 13:30:00”,79860.759

“2004-11-19 14:30:00”,81103.408

“2004-11-19 15:30:00”,75227.56

Additional Time Series formats supported by VisualizeIT include – VisualizeIT allows uploading of one set of “Timestamp, Value” into a given Application/Data Dimension at once.

“YYYY”

“YYYY-MM-DD”

“YYYY/MM/DD”

“YYYYMMDD”

“DD/MM/YYYY”

“DD-MM-YYYY”

“DDMMYYYY”

“YYYY-MM”

“YYYY/MM”

“MM-YYYY”

“MM/YYYY”

“YYYYQ1” (Can be Q1-Q4)

“Q1YYYY” (Can be Q1-Q4)

Limitations – There is a known limitation of VisualizeIT which you should be aware of and which might impact your ability to upload Time Series data. VisualizeIT currently does not support data prior to 1970 for any of the supported data formats. We are working on building capability into VisualizeIT such that the user is provided notification if a data-set is uploaded with data prior to 1970. In such cases, data for 1970 and beyond in that data-set should be successfully imported into the system while data prior to 1970 will be dropped.

Modelling Solution: VisualizeIT offers access to a bunch of Analytical Models, Statistical Models and Simulation Mcropped-visualize_it_logo__transparent_090415.pngodels for purposes of Visualization, Modelling & Forecasting. Access to all the Analytical (Mathematical) models is free. We recommend you try out the Analytical models at VisualizeIT which are free to use and drop us a note with your suggestions, input and comments. You can access the VisualizeIT website here and the VisualizeIT modelling solution here –VisualizeIT.

This entry was posted in   .
Bookmark the   permalink.

Admin has written 0 articles

VisualizeIT Administrator & Community Moderator