Autoplot Application (#{tag})

PngWalk Tool Digitizer correctly handles plots and images without X axis.

Autoplot attempts to allow plotting of data from many data sources, including remote CDF files and OpenDAP servers. Datasets are identified with URIs, and by the URI's extension, data are loaded into the internal data model. Data are then displayed by guessing the rendering method and axis ranges to provide a reasonable, useful view of the data. Data can then be additionally processed with other operations like smooth and FFT, and Jython scripting provides a capable programming environment.

This is the Autoplot v2019a branch. This is an update to the production version containing bugfixes and minor new features. Java 7 is now required. Java 8 will be required sometime soon.

Run with 4GB of memory (64-bit Java only): autoplot_4GB.jnlp

Single-jar version, autoplot.jar, can be run without network access and from the command line.

Mac DMG Release is available.

Bugfixes (2019-05-13 r23677):

• 2155: automatically set digitizer "sorted" property so that pixel locations don't clobber each other.
• TITLE property was printed twice in ASCII export.
• 2133: bug in Datum.Long to TimeStruct, where leap seconds were handled incorrectly, was corrected. Thanks, Darrell!
• %{TIMERANGE} macro can convert back to orbit number. Thanks, Ivar!
• 2154: support assignment of fill to dataset, where fill is copied or translated to the dataset's fill value. Thanks, Ivar!
• bug with new --quiet switch with AutoplotDataServer corrected.
• 1670: check for weight=0 with value=NaN, some codes assumed weight*value was valid. Thanks, Ivar!
• 2148: shift-execute correctly brings up the parameters dialog in the script editor.
• 2148: .jy scripts now get lint to check for common mistakes, before just .jyds scripts did.
• check for duplicate entries in CDAWeb file-finding service. This is a bug they will fix as well.
• 2140: top and bottom painters are automatically antialiased and have their own graphics context to protect other parts of the plot.
• 2140: add support for DasPlot top and bottom decorators.
• 2147: data reduction with series renderer and small pixels would result in washed-out image.
• 2146: autolayout incorrectly reclaims room for TCAs, adding noise to vap loading. Thanks, Kris!
• doDataSetReduce of SeriesRenderer now reduces to 1/2 pixel, so that "1px" sized black dots appear black.
• performance improvements to the HugeScatterRenderer.
• 2145: avoid infinite loop in Events List when there are no events in the next intervals.
• corrections to other bugs with the HAPI client when caching was turned on.
• performance improvements with new Das2Stream reader, along minor bugs pointed out by Jenkins tests.
• clean up old script examples in https://svn.code.sf.net/p/autoplot/code/autoplot/trunk/Autoplot/src/scripts/
• 2143: HAPI client respects dataset time boundaries when caching is enabled.
• rebinner API now passes information about the Z axis so interpolation can be fixed.
• "polar" render type corrects units.

Older Bugfixes:

• findbugs suggestions.
• 2138: when using X,Y,Z feature of CDF editor, Y metadata shown initially, not the Z data.
• 2127: code which appended virtual records on CDF variables which were too short didn't consider virtual variables. Thanks, Andrei!
• 0875: old branch was using aggregated URI in getDataSourceEditorPanel, causing bogus hit to remote servers.
• fall back to two columns when column count cannot be guessed with ASCII files, so that the editor shows the file instead of nothing.
• 2137: support for decimal years.
• 1629: NullPointerException in code which would verify Jython index. Thanks, Darrelle!
• 2136: when initial load results in "no data" still support TSB. Thanks, Baptiste and Chris!
• orbits file would use old http, not https locations.
• 2103: tick layout is done using floats, so that pdf output has uniform ticks.
• 1678: bind with the plot colorbar the source so that the new plotElements have to comply.
• 2133: detect LongReadAccess when CDF_TT2000 is used for timetags, so that CDF timetags can be formatted to ASCII with full resolution. Thanks, Eric!
• 2036: keep track of the parent of the monitor used for centering, after seeing that the hidden monitor would position properly when it becomes visible.
• 1629: getItem with index lists (ds[ idx0, idx1, 0 ]) works now. Thanks, Ivar!
• 2134: support rank 2 indeces, see https://github.com/autoplot/dev/blob/master/bugs/2134/

Features:

• redo the GUI for the display data dialog, so you can see and control the yclipping. Thanks, Ivar!
• 678: add mad function! Thanks, Ivar.
• PngWalkTool's write to animated gif and write to pdf file now have a button to copy the output filename.
• AutoplotDataServer has -q option to quiet informational messages on stderr. Thanks, Bob!
• file download now logs transfer rates to das2.filesystem.wfs at FINER.
• sftp support uses java property user.name to get the username by default, so two people can share .vaps with different .ssh keys.
• ImageVectorDataSetRenderer renamed to HugeScatterRebinner.
• Autoplot-based HAPI Server supports If-Modified-Since header.
• handle rank 1 with optimized loop in simpleRange.
• HAPI data source now caches binary transactions.
• Das2Streams are now read directly into QDataSet.
• DataSetBuilder can accept fields from DatumVector, for performance.
• imgscalr library added, which will provide faster thumbnails.
• polarToCartesian function and filter added.
• support Radio and Plasma Wave Group's GitLabs site with GitHubFileSystem.
• support U. Iowa GitLabs site with GitHubFileSystem.
• polar renderer supports x,y,z color scatter plot.
• new code reads Das2Streams directly into QDataSet.
• das2streams support x,y,z scatter. Clean up strange names in the das2stream parser.
• Renderer.render now takes Graphics2D object, instead of Graphics.
• API changes like removing monitor from render call will make scripting easier.

Less recent features:

• For JSON "Rich" ASCII files, throw unrecognized tags into USER_PROPERTIES.
• ASCII parser has new columnCount switch, where the column count can be asserted.
• Units.decimalYear added.
• 24hr-at-perikrone events lists for Cassini.
• add menu item for cassini.perikrone.24hr orbit list.
• 2133: export CDF_TT2000 to ASCII to nanosecond resolution.

Known issues:

• see Source Forge
• Bugs often have a four-digit ID and can be reviewed with https://sourceforge.net/p/autoplot/bugs/<ID>/.
• Features typically have a three-digit ID and can be reviewed with https://sourceforge.net/p/autoplot/feature-requests/<ID>/.

This completes the feature set for the new production branch. No major features will be added before branching this version. A production branch will be started in a couple of weeks, and the "Start Autoplot" link at the top of autoplot.org will run this version. Feedback on the function and quality of this release is greatly appreciated!

Data is input from:

• ASCII files (.dat,.txt)
• CSV files (.csv)
• Binary files (.bin)
• CDF files(.cdf)
• Excel spread sheets (.xls)
• das2Streams (.d2s or .das2Stream)
• ViRBO's TSDS server
• CDAWeb data server (vap+cdaweb:)
• das2servers (vap+das2server:)
• QStreams (.qds), QDataSet on a das2Stream
• Plasma Wave Group das2 Server
• NetCDF files (.nc,.ncml)
• HDF5 files (.h5,.hdf5)
• DODs servers (.dds)
• Cluster Exchange Format files (.cef)
• Fits Format Files
• Images (.jpg, .png, .gif)
• Wav audio files (.wav)

This is not complete, and limitations include:

• Quantities of rank 3 dimensionality (e.g. flux(Time,Energy,pitch) are plotted by slicing.
• Quantities of rank 4 dimensionality (e.g. flux(Time,Energy,azimuth,sector) are plotted by slicing twice.

autoplot.org is the wiki website, and contains more information than this launch page.