Many resources are needed to download a project. Please understand that we have to compensate our server costs. Thank you in advance. Project price only 1 $
You can buy this project and download/modify it how often you want.
A data frame of January datasets which
can be written and read from HDF5.
The data is lazy, you may write slices of the
data table. The Table is nD, each written "column"
does not have to be 1D.
The data is written in HDF in an easy way to call the
DataFrame constructor from python. It is not written
in the DataFrame format for HDF5 because that is not
very nice for further analysis. Instead the data is
stored in hdf5-NeXus format which is a block of contiguous
data that may be sliced.
public DataFrame(java.lang.String name,
int dtype,
Dataset... columns)
throws DatasetException
Throws:
DatasetException
DataFrame
public DataFrame(ILazyDataset data,
int dtype)
DataFrame
public DataFrame(ILazyDataset data,
int index,
java.util.List<java.lang.String> names,
int dtype)
Method Detail
to_hdf
public DataFrame to_hdf(java.lang.String filePath,
java.lang.String h5Path)
throws NexusException,
java.io.IOException,
DatasetException
This method imports all the data frame into memory then writes it to HDF.
Parameters:
filePath -
Throws:
NexusException
java.io.IOException
DatasetException
to_lazy_hdf
public DataFrame to_lazy_hdf(java.lang.String filePath,
java.lang.String h5Path)
throws java.lang.Exception
This method writes the data in slices down the column axis.
If your data is already in a true LazyDataset it will be sliced
in the column axis and each slice written to HDF. This might
be more memory efficient depending on what you are writing.
Parameters:
filePath -
Throws:
java.lang.Exception
open_hdf
public Appender open_hdf(java.lang.String filePath,
java.lang.String h5Path)
throws NexusException,
java.io.IOException
Open the file for appending data yourself.
Parameters:
filePath -
h5Path -
Returns:
Throws:
java.io.IOException
NexusException
read_hdf
public DataFrame read_hdf(java.lang.String filePath)
throws NexusException,
java.io.IOException,
DatasetException
Read a dataframe as LazyDatasets from the file.
Parameters:
filePath -
Throws:
NexusException
java.io.IOException
DatasetException
getName
public java.lang.String getName()
setName
public void setName(java.lang.String name)
create
public static ILazyWriteableDataset create(java.lang.String name,
int dtype)
Creates a tabular writeable dataset using the shape of one column.
Parameters:
name -
dtype -
Returns:
writeable dataset
create
public static ILazyWriteableDataset create(java.lang.String name,
int dtype,
int[] columnShape)
Creates a writeable dataset using the shape of one column.
Parameters:
name -
dtype -
columnShape -
Returns:
writeable dataset
create
public static ILazyWriteableDataset create(java.lang.String name,
int dtype,
int[] columnShape,
int sizeSlices)
Creates a writeable dataset using the shape of one column.