Access to .CSV data feed

[DanK]

Hi All,

For my ioBridge project I propose to access the ioBridge functionality from a web page (but not ioBridge.com),  the widgets are easy to control as ioBridge provide the code but I have a problem with the data in the data log.

I am using channel 4 of my module for data logging and the results can be seen on the chart ioBridge provide as well as the .csv file which I can download from the ioBridge site.  Although this is great I cannot seem to access the data itself. I really need a feed so I can create my own charts etc independently from the iobridge.com site without having to manually download .csv files all the time.

Can anyone tell me how I can access my data (.csv file) directly (as a feed so I can automate).

I have noticed that someone has asked for similar information to be available without logging in to the ioBridge site, I guess this is similar request?!? (The data outside of ioBridge)

Any assistance would be appreciated,

Thanks

Dan

[iobridge]

We also got your email regarding this question. We were ready to reply and saw your post.

Are you looking to get access to the data logs remotely or to log the data on your own server? You can log your own data using the data feed API.

http://www.iobridge.net/wiki/api/data-feed-api

We have not setup remote access to the data logs themselves, but it is a feature we are considering. It will be possible to send a date and time range and get a slice of your data logs in XML or CSV format. That feature is in the works.

[DanK]

Thanks for the response.

I'm not sure this helps me but maybe I need to explain a little more what I am trying to do or maybe I've not understood.

I have set up my ioBridge to monitor to do data logging on channel 4 as "digital input counting", this setup allows me to monitor a pulsing LED and every 600 seconds I get a time stamped reading of the number of pulses that have occurred.

I can see this data from your website as a bar chart or download the .csv file, this is great but I have two problem which I can't seem to resolve (hence these questions).


Problem 1.

Using your JSON feed I only get a snapshot of what is happening at a point in time and not the accumulated pulse count over the 600 second period.  For temperature monitoring a snapshot is fine but using this feed against  my "digital input counting" channel I would only every see a 1 or 0 and never the actual count of pulses.

For my project I need access to the number of pulses counted every 600 seconds with a timestamp (the same information as your downloadable .csv file).  I need this data as I intend to pass it to another application so I can do some statistical analysis with it.


Problem 2.

I have seen a similar post on the forum (http://www.iobridge.net/forum/index.php/topic,451.msg1858.html#msg1858) which relates to viewing data without logging in to ioBridge.com  If I had access to the data directly I could create my own charts (via google for example) and share with others which is a key part of my project.


If you can assist I would be very grateful.

Many thanks.

Dan

[jason]

Digital input counting for a data log is done on the server, not the module.   On the server the counting is on separate process than the one running the Data Feed API.  There is no quick and easy way to combine them.  It suppose it would be possible to add the digital input count to the data feed but would take some work on our end.   

[rlemmens]

i hope that IObridge really works on the server app that you can run yourself. In this way you have direct access to your data. I also am looking for the solution to have direct access to pulse logging data.

[iobridge]

This is a very old thread, it's probably misleading.

We released onboard pulse counting in the C4+ firmware updates. We will release a minor firmware update soon that allows for a new data logging type - ioBridge.com will log the pulse count from the module. If the module goes offline or misses an update, the count is still preserved.

[iobridge]

Also, the Data Feed API contains your pulse count now. At the time of this original thread we had not released the pulse counting on the firmware.

http://www.iobridge.net/wiki/api/data-feed-api

[Ollie]

Perhaps I am overlooking something obvious but is there any way to get the .CSV data via ftp or other means that isn't manual?   I would like to grab data for an analog input averaging log every 10 minutes to monitor a moving average.

[iobridge]

A CSV slice of data from a data log is available thru the data_log_select API.

Code: [Select]

http://www.iobridge.com/api/data_log_select/key=[data log key]
This returns a CSV of the past 24 hours of data. You can specify the start and end dates for a more specific section of the data. This is currently unpublished, but it does work if you want to try it out.

[Ollie]

That's exactly what I need!  Thank you! 

How do I specify the dates (and times, if possible)?  I might not need a full 24 hours worth of data,

[iobridge]

Code: [Select]

&start=

Code: [Select]

&end=
The time date format is the following:

Code: [Select]

yyyy-mm-dd hh:nn:ss
You can also specify an offset:

Code: [Select]

&offset=
Like, "-4" for EST with day light savings.

[jbatchelor51]

Any news on getting the CSV as XML?  I am looking to embed historical data into a shockwave flash dashboard (Xcelsius). This product uses Excel with XML maps to get data from a live connection.  I am currently reading realtime data with no problem, but want to combine my electrical use and weather data streams together.  Both of which are XML live and XML historical.
thanks!

[iobridge]

We are revamping all of the APIs - I will make sure XML is on the feature list.