taucmdr.cf.storage.local_file module

Local file backend for storage containers.

A persistent, transactional record storage system using TinyDB for both the database and the key/value store.

class taucmdr.cf.storage.local_file.LocalFileStorage(name, prefix)[source]

Bases: taucmdr.cf.storage.AbstractStorage

A persistent, transactional record storage system.

Uses TinyDB for both the database and the key/value store.

dbfile

str

Absolute path to database file.

Record

alias of _JsonRecord

__enter__()[source]

Initiates the database transaction.

__exit__(ex_type, value, traceback)[source]

Finalizes the database transaction.

__str__()[source]

Human-readable identifier for this database.

static _query(keys, match_any)[source]

Construct a TinyDB query object.

connect_database(*args, **kwargs)[source]

Open the database for reading and writing.

connect_filesystem(*args, **kwargs)[source]

Prepares the store filesystem for reading and writing.

contains(keys, table_name=None, match_any=False)[source]

Check if the specified table contains at least one matching record.

The behavior depends on the type of keys:
  • self.Record.eid_type: check for the record with that element identifier.
  • dict: check for the record with attributes matching keys.
  • list or tuple: return the equivalent of map(contains, keys).
  • None: return False.
Parameters:
  • keys – Fields or element identifiers to match.
  • table_name (str) – Name of the table to operate on. See AbstractDatabase.table.
  • match_any (bool) – Only applies if keys is a dictionary. If True then any key in keys may match or if False then all keys in keys must match.
Returns:

True if the table contains at least one matching record, False otherwise.
Return type:

bool
Raises:

ValueError – Invalid value for keys.
count(table_name=None)[source]

Count the records in the database.

Parameters:table_name (str) – Name of the table to operate on. See AbstractDatabase.table.
Returns:Number of records in the table.
Return type:int
database_exists()[source]
dbfile
disconnect_database(*args, **kwargs)[source]

Close the database for reading and writing.

disconnect_filesystem(*args, **kwargs)[source]

Disconnects the store filesystem.

get(keys, table_name=None, match_any=False)[source]

Find a single record.

The behavior depends on the type of keys:
  • self.Record.eid_type: return the record with that element identifier.
  • dict: return the record with attributes matching keys.
  • list or tuple: return a list of records matching the elements of keys
  • None: return None.
Parameters:
  • keys – Fields or element identifiers to match.
  • table_name (str) – Name of the table to operate on. See AbstractDatabase.table.
  • match_any (bool) – Only applies if keys is a dictionary. If True then any key in keys may match or if False then all keys in keys must match.
Returns:

The matching data record if keys was a self.Record.eid_type or dict. list: All matching data records if keys was a list or tuple. None: No record found or bool(keys) == False.
Return type:

Record
Raises:

ValueError – Invalid value for keys.
insert(data, table_name=None)[source]

Create a new record.

If the table doesn’t exist it will be created.

Parameters:
  • data (dict) – Data to insert in table.
  • table_name (str) – Name of the table to operate on. See AbstractDatabase.table.
Returns:

The new record.
Return type:

Record
is_writable()[source]

Check if the storage filesystem is writable.

Attempts to create and delete a file in prefix. See https://github.com/ParaToolsInc/taucmdr/issues/231.

Returns:True if a file could be created and deleted in prefix, False otherwise.
Return type:bool
items()[source]
keys()[source]
match(field, table_name=None, regex=None, test=None)[source]

Find records where field matches regex or test.

Either regex or test may be specified, not both. If regex is given, then all records with field matching the regular expression are returned. If test is given then all records with field set to a value that caues test to return True are returned. If neither is given, return all records where field is set to any value.

Parameters:
  • table_name (str) – Name of the table to operate on. See AbstractDatabase.table.
  • field (string) – Name of the data field to match.
  • regex (string) – Regular expression string.
  • test – Callable returning a boolean value.
Returns:

Matching data records.
Return type:

list
Raises:

ValueError – Invalid value for keys.
prefix
purge(table_name=None)[source]

Delete all records.

Parameters:table_name (str) – Name of the table to operate on. See AbstractDatabase.table.
remove(keys, table_name=None, match_any=False)[source]

Delete records.

The behavior depends on the type of keys:
  • self.Record.eid_type: delete the record with that element identifier.
  • dict: delete all records with attributes matching keys.
  • list or tuple: delete all records matching the elements of keys.
Parameters:
  • keys – Fields or element identifiers to match.
  • table_name (str) – Name of the table to operate on. See AbstractDatabase.table.
  • match_any (bool) – Only applies if keys is a dictionary. If True then any key in keys may match or if False then all keys in keys must match.
Raises:

ValueError – bool(keys) == False or invalid value for keys.
search(keys=None, table_name=None, match_any=False)[source]

Find multiple records.

The behavior depends on the type of keys:
  • self.Record.eid_type: return the record with that element identifier.
  • dict: return all records with attributes matching keys.
  • list or tuple: return a list of records matching the elements of keys
  • None: return all records.
Parameters:
  • keys – Fields or element identifiers to match.
  • table_name (str) – Name of the table to operate on. See AbstractDatabase.table.
  • match_any (bool) – Only applies if keys is a dictionary. If True then any key in keys may match or if False then all keys in keys must match.
Returns:

Matching data records.
Return type:

list
Raises:

ValueError – Invalid value for keys.
table(table_name)[source]
unset(fields, keys, table_name=None, match_any=False)[source]

Update records by unsetting fields.

Update only allows you to update a record by adding new fields or overwriting existing fields. Use this method to remove a field from the record.

The behavior depends on the type of keys:
  • self.Record.eid_type: update the record with that element identifier.
  • dict: update all records with attributes matching keys.
  • list or tuple: apply update to all records matching the elements of keys.
Parameters:
  • fields (list) – Names of fields to remove from matching records.
  • keys – Fields or element identifiers to match.
  • table_name (str) – Name of the table to operate on. See AbstractDatabase.table.
  • match_any (bool) – Only applies if keys is a dictionary. If True then any key in keys may match or if False then all keys in keys must match.
Raises:

ValueError – bool(keys) == False or invalid value for keys.
update(fields, keys, table_name=None, match_any=False)[source]

Update records.

The behavior depends on the type of keys:
  • self.Record.eid_type: update the record with that element identifier.
  • dict: update all records with attributes matching keys.
  • list or tuple: apply update to all records matching the elements of keys.
Parameters:
  • fields (dict) – Data to record.
  • keys – Fields or element identifiers to match.
  • table_name (str) – Name of the table to operate on. See AbstractDatabase.table.
  • match_any (bool) – Only applies if keys is a dictionary. If True then any key in keys may match or if False then all keys in keys must match.
Raises:

ValueError – bool(keys) == False or invalid value for keys.
values()[source]
class taucmdr.cf.storage.local_file._JsonFileStorage(path)[source]

Bases: tinydb.storages.JSONStorage

Allow read-only as well as read-write access to the JSON file.

TinyDB’s default storage (tinydb.JSONStorage) assumes write access to the JSON file. This isn’t the case for system-level storage and possibly others.

write(*args, **kwargs)[source]