All Downloads are FREE. Search and download functionalities are using the official Maven repository.

com.sleepycat.je.SecondaryDatabase Maven / Gradle / Ivy

The newest version!
/*-
 * Copyright (C) 2002, 2018, Oracle and/or its affiliates. All rights reserved.
 *
 * This file was distributed by Oracle as part of a version of Oracle Berkeley
 * DB Java Edition made available at:
 *
 * http://www.oracle.com/technetwork/database/database-technologies/berkeleydb/downloads/index.html
 *
 * Please see the LICENSE file included in the top-level directory of the
 * appropriate version of Oracle Berkeley DB Java Edition for a copy of the
 * license and additional information.
 */

package com.sleepycat.je;

import java.util.Collection;
import java.util.Collections;
import java.util.HashSet;
import java.util.List;
import java.util.Set;
import java.util.logging.Level;

import com.sleepycat.je.dbi.CursorImpl;
import com.sleepycat.je.dbi.DatabaseImpl;
import com.sleepycat.je.dbi.EnvironmentImpl;
import com.sleepycat.je.dbi.ExpirationInfo;
import com.sleepycat.je.dbi.GetMode;
import com.sleepycat.je.dbi.PutMode;
import com.sleepycat.je.dbi.SearchMode;
import com.sleepycat.je.dbi.TTL;
import com.sleepycat.je.txn.Locker;
import com.sleepycat.je.txn.LockerFactory;
import com.sleepycat.je.utilint.DatabaseUtil;
import com.sleepycat.je.utilint.DbLsn;
import com.sleepycat.je.utilint.LoggerUtils;

/**
 * A secondary database handle.
 *
 * 

Secondary databases are opened with {@link * Environment#openSecondaryDatabase Environment.openSecondaryDatabase} and are * always associated with a single primary database. The distinguishing * characteristics of a secondary database are:

* *
    *
  • Records are automatically added to a secondary database when records are * added, modified and deleted in the primary database. Direct calls to * put() methods on a secondary database are prohibited.
  • *
  • The {@link #delete delete} method of a secondary database will delete * the primary record and as well as all its associated secondary records.
  • *
  • Calls to all get() methods will return the data from the * associated primary database.
  • *
  • Additional get() method signatures are provided to return * the primary key in an additional pKey parameter.
  • *
  • Calls to {@link #openCursor openCursor} will return a {@link * SecondaryCursor}, which itself has get() methods that return * the data of the primary database and additional get() method * signatures for returning the primary key.
  • *
*

Before opening or creating a secondary database you must implement * the {@link SecondaryKeyCreator} or {@link SecondaryMultiKeyCreator} * interface.

* *

For example, to create a secondary database that supports duplicates:

* *
 *     Database primaryDb; // The primary database must already be open.
 *     SecondaryKeyCreator keyCreator; // Your key creator implementation.
 *     SecondaryConfig secConfig = new SecondaryConfig();
 *     secConfig.setAllowCreate(true);
 *     secConfig.setSortedDuplicates(true);
 *     secConfig.setKeyCreator(keyCreator);
 *     SecondaryDatabase newDb = env.openSecondaryDatabase(transaction,
 *                                                         "myDatabaseName",
 *                                                         primaryDb,
 *                                                         secConfig)
 * 
* *

If a primary database is to be associated with one or more secondary * databases, it may not be configured for duplicates.

* *

WARNING: The associations between primary and secondary databases * are not stored persistently. Whenever a primary database is opened for * write access by the application, the appropriate associated secondary * databases should also be opened by the application. This is necessary to * ensure data integrity when changes are made to the primary database. If the * secondary database is not opened, it will not be updated when the primary is * updated, and the references between the databases will become invalid. * (Note that this warning does not apply when using the {@link * com.sleepycat.persist DPL}, which does store secondary relationships * persistently.)

* *

Special considerations for using Secondary * Databases with and without Transactions

* *

Normally, during a primary database write operation (insert, update or * delete), all associated secondary databases are also updated. However, when * an exception occurs during the write operation, the updates may be * incomplete. If the databases are transactional, this is handled by aborting * the transaction to undo the incomplete operation. If an auto-commit * transaction is used (null is passed for the transaction), the transaction * will be aborted automatically. If an explicit transaction is used, it * must be aborted by the application caller after the exception is caught.

* *

However, if the databases are non-transactional, integrity problems can * result when an exception occurs during the write operation. Because the * write operation is not made atomic by a transaction, references between the * databases will become invalid if the operation is incomplete. This results * in a {@link SecondaryIntegrityException} when attempting to access the * databases later.

* *

A secondary integrity problem is persistent; it cannot be resolved by * reopening the databases or the environment. The only way to resolve the * problem is to restore the environment from a valid backup, or, if the * integrity of the primary database is assumed, to remove and recreate all * secondary databases.

* *

Therefore, secondary databases and indexes should always be used in * conjunction with transactional databases and stores. Without transactions, * it is the responsibility of the application to handle the results of the * incomplete write operation or to take steps to prevent this situation from * happening in the first place.

* *

The following exceptions may be thrown during a write operation, and may * cause an integrity problem in the absence of transactions.

*
    *
  • {@link SecondaryConstraintException}, see its subclasses for more * information.
  • *
  • {@link LockConflictException}, when more than one thread is accessing * the databases.
  • *
  • {@link EnvironmentFailureException}, if an unexpected or system failure * occurs.
  • *
  • There is always the possibility of an {@link Error} or an unintended * {@link RuntimeException}.
  • *
*/ public class SecondaryDatabase extends Database { /* For type-safe check against EMPTY_SET */ private static final Set EMPTY_SET = Collections.emptySet(); private final Database primaryDatabase; // May be null. private SecondaryConfig secondaryConfig; private volatile boolean isFullyPopulated = true; /** * Creates a secondary database but does not open or fully initialize it. * * @throws IllegalArgumentException via Environment.openSecondaryDatabase. */ SecondaryDatabase(final Environment env, final SecondaryConfig secConfig, final Database primaryDatabase) { super(env); this.primaryDatabase = primaryDatabase; if (primaryDatabase == null) { if (secConfig.getSecondaryAssociation() == null) { throw new IllegalArgumentException( "Exactly one must be non-null: " + "PrimaryDatabase or SecondaryAssociation"); } if (secConfig.getAllowPopulate()) { throw new IllegalArgumentException( "AllowPopulate must be false when a SecondaryAssociation" + " is configured"); } } else { if (secConfig.getSecondaryAssociation() != null) { throw new IllegalArgumentException( "Exactly one must be non-null: " + "PrimaryDatabase or SecondaryAssociation"); } primaryDatabase.checkOpen(); if (primaryDatabase.configuration.getSortedDuplicates()) { throw new IllegalArgumentException( "Duplicates not allowed for a primary database: " + primaryDatabase.getDatabaseName()); } if (env.getNonNullEnvImpl() != primaryDatabase.getEnvironment().getNonNullEnvImpl()) { throw new IllegalArgumentException( "Primary and secondary databases must be in the same" + " environment"); } if (!primaryDatabase.configuration.getReadOnly() && secConfig.getKeyCreator() == null && secConfig.getMultiKeyCreator() == null) { throw new IllegalArgumentException( "SecondaryConfig.getKeyCreator()/getMultiKeyCreator()" + " may be null only if the primary database is read-only"); } } if (secConfig.getKeyCreator() != null && secConfig.getMultiKeyCreator() != null) { throw new IllegalArgumentException( "secConfig.getKeyCreator() and getMultiKeyCreator() may not" + " both be non-null"); } if (secConfig.getForeignKeyNullifier() != null && secConfig.getForeignMultiKeyNullifier() != null) { throw new IllegalArgumentException( "secConfig.getForeignKeyNullifier() and" + " getForeignMultiKeyNullifier() may not both be non-null"); } if (secConfig.getForeignKeyDeleteAction() == ForeignKeyDeleteAction.NULLIFY && secConfig.getForeignKeyNullifier() == null && secConfig.getForeignMultiKeyNullifier() == null) { throw new IllegalArgumentException( "ForeignKeyNullifier or ForeignMultiKeyNullifier must be" + " non-null when ForeignKeyDeleteAction is NULLIFY"); } if (secConfig.getForeignKeyNullifier() != null && secConfig.getMultiKeyCreator() != null) { throw new IllegalArgumentException( "ForeignKeyNullifier may not be used with" + " SecondaryMultiKeyCreator -- use" + " ForeignMultiKeyNullifier instead"); } if (secConfig.getForeignKeyDatabase() != null) { Database foreignDb = secConfig.getForeignKeyDatabase(); if (foreignDb.getDbImpl().getSortedDuplicates()) { throw new IllegalArgumentException( "Duplicates must not be allowed for a foreign key " + " database: " + foreignDb.getDatabaseName()); } } } /** * Create a database, called by Environment */ @Override DatabaseImpl initNew(final Environment env, final Locker locker, final String databaseName, final DatabaseConfig dbConfig) { final DatabaseImpl dbImpl = super.initNew(env, locker, databaseName, dbConfig); init(locker); return dbImpl; } /** * Open a database, called by Environment * * @throws IllegalArgumentException via Environment.openSecondaryDatabase. */ @Override void initExisting(final Environment env, final Locker locker, final DatabaseImpl database, final String databaseName, final DatabaseConfig dbConfig) { /* Disallow one secondary associated with two different primaries. */ if (primaryDatabase != null) { Database otherPriDb = database.findPrimaryDatabase(); if (otherPriDb != null && otherPriDb.getDbImpl() != primaryDatabase.getDbImpl()) { throw new IllegalArgumentException( "Secondary already associated with different primary: " + otherPriDb.getDatabaseName()); } } super.initExisting(env, locker, database, databaseName, dbConfig); init(locker); } /** * Adds secondary to primary's list, and populates the secondary if needed. * * @param locker should be the locker used to open the database. If a * transactional locker, the population operations will occur in the same * transaction; this may result in a large number of retained locks. If a * non-transactional locker, the Cursor will create a ThreadLocker (even if * a BasicLocker used for handle locking is passed), and locks will not be * retained. */ private void init(final Locker locker) { trace(Level.FINEST, "SecondaryDatabase open"); getDbImpl().setKnownSecondary(); secondaryConfig = (SecondaryConfig) configuration; Database foreignDb = secondaryConfig.getForeignKeyDatabase(); if (foreignDb != null) { foreignDb.foreignKeySecondaries.add(this); } /* Populate secondary if requested and secondary is empty. */ if (!secondaryConfig.getAllowPopulate()) { return; } Cursor secCursor = null; Cursor priCursor = null; try { secCursor = new Cursor(this, locker, null); DatabaseEntry key = new DatabaseEntry(); DatabaseEntry data = new DatabaseEntry(); OperationResult result = secCursor.position( key, data, LockMode.DEFAULT, null, true); if (result != null) { return; } /* Is empty, so populate */ priCursor = new Cursor(primaryDatabase, locker, null); result = priCursor.position( key, data, LockMode.DEFAULT, null, true); while (result != null) { updateSecondary( locker, secCursor, primaryDatabase.getDbImpl(), priCursor.getCursorImpl(), key /*priKey*/, null /*oldData*/, data /*newData*/, null /*cacheMode*/, result.getExpirationTime(), false /*expirationUpdated*/, result.getExpirationTime()); result = priCursor.retrieveNext( key, data, LockMode.DEFAULT, null, GetMode.NEXT); } } finally { if (secCursor != null) { secCursor.close(); } if (priCursor != null) { priCursor.close(); } } } @Override SecondaryAssociation makeSecondaryAssociation() { /* Only one is non-null: primaryDatabase, SecondaryAssociation. */ if (primaryDatabase != null) { primaryDatabase.simpleAssocSecondaries.add(this); return primaryDatabase.secAssoc; } return configuration.getSecondaryAssociation(); } /** * Closes a secondary database and dis-associates it from its primary * database. A secondary database should be closed before closing its * associated primary database. * * {@inheritDoc} * * */ @Override public synchronized void close() { /* removeReferringAssociations will be called during close. */ super.close(); } @Override void removeReferringAssociations() { super.removeReferringAssociations(); if (primaryDatabase != null) { primaryDatabase.simpleAssocSecondaries.remove(this); } if (secondaryConfig != null) { final Database foreignDb = secondaryConfig.getForeignKeyDatabase(); if (foreignDb != null) { foreignDb.foreignKeySecondaries.remove(this); } } } /** * @hidden * For internal use only. * * Enables incremental population of this secondary database, so that index * population can occur incrementally, and concurrently with primary * database writes. *

* After calling this method (and before calling {@link * #endIncrementalPopulation}), it is expected that the application will * populate the secondary explicitly by calling {@link * Database#populateSecondaries} to process all records for the primary * database(s) associated with this secondary. *

* The concurrent population mode supports concurrent indexing by ordinary * writes to the primary database(s) and calls to {@link * Database#populateSecondaries}. To provide this capability, some * primary-secondary integrity checking is disabled. The integrity * checking (that is disabled) is meant only to detect application bugs, * and is not necessary for normal operations. Specifically, the checks * that are disabled are: *

    *
  • When a new secondary key is inserted, because a primary record is * inserted or updated, we normally check that a key mapped to the * primary record does not already exist in the secondary database.
  • *
  • When an existing secondary key is deleted, because a primary * record is updated or deleted, we normally check that a key mapped to * the primary record already does exist in the secondary database.
  • *
* Without these checks, one can think of the secondary indexing operations * as being idempotent. Via the idempotent indexing operations, explicit * population (via {@link Database#populateSecondaries}) and normal * secondary population (via primary writes) collaborate to add and delete * index records as needed. */ public void startIncrementalPopulation() { isFullyPopulated = false; } /** * @hidden * For internal use only. * * Disables incremental population of this secondary database, after this * index has been fully populated. *

* After calling this method, this database may not be populated by calling * {@link Database#populateSecondaries}, and all primary-secondary * integrity checking for this secondary is enabled. */ public void endIncrementalPopulation() { isFullyPopulated = true; } /** * @hidden * For internal use only. * * @return true if {@link #startIncrementalPopulation} was called, and * {@link #endIncrementalPopulation} was not subsequently called. */ public boolean isIncrementalPopulationEnabled() { return !isFullyPopulated; } /** * @hidden * For internal use only. * * Reads {@code batchSize} records starting at the given {@code key} and * {@code data}, and deletes any secondary records having a primary key * (the data of the secondary record) for which {@link * SecondaryAssociation#getPrimary} returns null. The next key/data pair * to be processed is returned in the {@code key} and {@code data} * parameters so these can be passed in to process the next batch. *

* It is the application's responsibility to save the key/data pair * returned by this method, and then pass the saved key/data when the * method is called again to process the next batch of records. The * application may wish to save the key/data persistently in order to avoid * restarting the processing from the beginning of the database after a * crash. * * @param key contains the starting key for the batch of records to be * processed when this method is called, and contains the next key to be * processed when this method returns. If {@code key.getData() == null} * when this method is called, the batch will begin with the first record * in the database. * * @param data contains the starting data element (primary key) for the * batch of records to be processed when this method is called, and * contains the next data element to be processed when this method returns. * If {@code key.getData() == null} when this method is called, the batch * will begin with the first record in the database. * * @param batchSize is the maximum number of records to be read, and also * the maximum number of deletions that will be included in a single * transaction. * * @return true if more records may need to be processed, or false if * processing is complete. * * @throws OperationFailureException if one of the Write * Operation Failures occurs. * * @throws EnvironmentFailureException if an unexpected, internal or * environment-wide failure occurs. * * @throws UnsupportedOperationException if this database is read-only. * * @throws IllegalStateException if the database has been closed. * * @throws IllegalArgumentException if an invalid parameter is specified. * This includes passing a null input key parameter or a null input data * parameter. */ public boolean deleteObsoletePrimaryKeys(final DatabaseEntry key, final DatabaseEntry data, final int batchSize) { try { checkEnv(); DatabaseUtil.checkForNullDbt(key, "key", false); if (batchSize <= 0) { throw new IllegalArgumentException( "batchSize must be positive"); } final DatabaseImpl dbImpl = checkOpen(); trace(Level.FINEST, "deleteObsoletePrimaryKeys", null, key, null, null); final Locker locker = LockerFactory.getWritableLocker( envHandle, null, dbImpl.isInternalDb(), isTransactional(), dbImpl.isReplicated() /*autoTxnIsReplicated*/); try { final boolean result; try (final Cursor cursor = new Cursor(this, locker, null)) { result = deleteObsoletePrimaryKeysInternal( cursor, key, data, batchSize); } locker.operationEnd(true); return result; } catch (final Throwable e) { locker.operationEnd(false); throw e; } } catch (Error E) { envHandle.invalidate(E); throw E; } } /** * Use a scan to walk through the primary keys. If the primary key is * obsolete (SecondaryAssociation.getPrimary returns null), delete the * record. */ private boolean deleteObsoletePrimaryKeysInternal(final Cursor cursor, final DatabaseEntry key, final DatabaseEntry data, final int batchSize) { /* TODO: use dirty-read scan with mode to return deleted records. */ final LockMode scanMode = LockMode.RMW; OperationResult searchResult; if (key.getData() == null) { /* Start at first key. */ searchResult = cursor.position(key, data, scanMode, null, true); } else { /* Resume at key/data pair last processed. */ searchResult = cursor.search( key, data, scanMode, null, SearchMode.BOTH_RANGE, false); if (searchResult == null) { searchResult = cursor.search( key, data, scanMode, null, SearchMode.SET_RANGE, false); } } int nProcessed = 0; while (searchResult != null) { if (nProcessed >= batchSize) { return true; } nProcessed += 1; if (secAssoc.getPrimary(data) == null) { cursor.deleteNoNotify(null, getDbImpl().getRepContext()); } searchResult = cursor.retrieveNext( key, data, scanMode, null, GetMode.NEXT); } return false; } /** * @hidden * For internal use only. */ @Override public void populateSecondaries(final Transaction txn, final DatabaseEntry key, final DatabaseEntry data) { throw new UnsupportedOperationException("Not allowed on a secondary"); } /** * @hidden * For internal use only. */ @Override public void populateSecondaries(final Transaction txn, final DatabaseEntry key, final DatabaseEntry data, final long expirationTime, CacheMode cacheMode) { throw new UnsupportedOperationException("Not allowed on a secondary"); } /** * Returns the primary database associated with this secondary database. * * @return the primary database associated with this secondary database. */ /* * To be added when SecondaryAssociation is published: * If a {@link SecondaryAssociation} is {@link * SecondaryCursor#setSecondaryAssociation configured}, this method returns * null. */ public Database getPrimaryDatabase() { return primaryDatabase; } /** * Returns an empty list, since this database is itself a secondary * database. */ @Override public List getSecondaryDatabases() { return Collections.emptyList(); } /** * Returns a copy of the secondary configuration of this database. * * @return a copy of the secondary configuration of this database. * * @throws EnvironmentFailureException if an unexpected, internal or * environment-wide failure occurs. * * @deprecated As of JE 4.0.13, replaced by {@link * SecondaryDatabase#getConfig()}. */ public SecondaryConfig getSecondaryConfig() { return getConfig(); } /** * Returns a copy of the secondary configuration of this database. * * @return a copy of the secondary configuration of this database. * * @throws EnvironmentFailureException if an unexpected, internal or * environment-wide failure occurs. */ @Override public SecondaryConfig getConfig() { return (SecondaryConfig) super.getConfig(); } /** * Returns the secondary config without cloning, for internal use. */ SecondaryConfig getPrivateSecondaryConfig() { return secondaryConfig; } /** * Obtain a cursor on a database, returning a * SecondaryCursor. Calling this method is the equivalent of * calling {@link #openCursor} and casting the result to {@link * SecondaryCursor}. * * @param txn the transaction used to protect all operations performed with * the cursor, or null if the operations should not be transaction * protected. If the database is non-transactional, null must be * specified. For a transactional database, the transaction is optional * for read-only access and required for read-write access. * * @param cursorConfig The cursor attributes. If null, default attributes * are used. * * @return A secondary database cursor. * * @throws EnvironmentFailureException if an unexpected, internal or * environment-wide failure occurs. * * @deprecated As of JE 4.0.13, replaced by {@link * SecondaryDatabase#openCursor}. */ public SecondaryCursor openSecondaryCursor( final Transaction txn, final CursorConfig cursorConfig) { return openCursor(txn, cursorConfig); } /** * Obtain a cursor on a database, returning a SecondaryCursor. */ @Override public SecondaryCursor openCursor(final Transaction txn, final CursorConfig cursorConfig) { checkReadable(); return (SecondaryCursor) super.openCursor(txn, cursorConfig); } /** * Overrides Database method. */ @Override Cursor newDbcInstance(final Transaction txn, final CursorConfig cursorConfig) { return new SecondaryCursor(this, txn, cursorConfig); } /** * Deletes the record associated with the given secondary key. In the * presence of duplicate keys, all primary records associated with the * given secondary key will be deleted. * *

When multiple primary records are deleted, the expiration time in the * returned result is that of the last record deleted.

* *

When the primary records are deleted, their associated secondary * records are deleted as if {@link Database#delete} were called. This * includes, but is not limited to, the secondary record referenced by the * given key.

* * @param key the key used as * input. * * */ @Override public OperationResult delete(final Transaction txn, final DatabaseEntry key, final WriteOptions options) { checkEnv(); final DatabaseImpl dbImpl = checkReadable(); trace(Level.FINEST, "SecondaryDatabase.delete", txn, key, null, null); final CacheMode cacheMode = options != null ? options.getCacheMode() : null; final Locker locker = LockerFactory.getWritableLocker( envHandle, txn, dbImpl.isInternalDb(), isTransactional(), dbImpl.isReplicated()); // autoTxnIsReplicated OperationResult commitResult = null; try { final LockMode lockMode = locker.isSerializableIsolation() ? LockMode.RMW : LockMode.READ_UNCOMMITTED_ALL; try (Cursor cursor = new Cursor(this, locker, null)) { /* Do not count NEXT_DUP ops. */ cursor.excludeFromOpStats(); /* Read the primary key (the data of a secondary). */ final DatabaseEntry pKey = new DatabaseEntry(); OperationResult searchResult = cursor.search( key, pKey, lockMode, cacheMode, SearchMode.SET, false); /* * For each duplicate secondary key, delete the primary record * and all its associated secondary records, including the one * referenced by this secondary cursor. */ while (searchResult != null) { final Database primaryDb = getPrimary(pKey); if (primaryDb == null) { /* Primary was removed from the association. */ cursor.deleteNoNotify( null, dbImpl.getRepContext()); } else { commitResult = primaryDb.deleteInternal( locker, pKey, cacheMode); if (commitResult == null) { if (lockMode != LockMode.RMW) { /* * The primary record was not found. The index * may be either corrupt or the record was * deleted between finding it in the secondary * without locking and trying to delete it. If * it was deleted or expired then just skip it. */ if (cursor.checkCurrent(LockMode.RMW, null) != null) { /* There is a secondary index entry */ throw secondaryRefersToMissingPrimaryKey( locker, primaryDb, key, pKey, searchResult.getExpirationTime()); } } else { if (!cursor.cursorImpl.isProbablyExpired()) { /* There is a secondary index entry. */ throw secondaryRefersToMissingPrimaryKey( locker, primaryDb, key, pKey, searchResult.getExpirationTime()); } } } } checkOpen(); searchResult = cursor.retrieveNext( key, pKey, lockMode, null, GetMode.NEXT_DUP); } if (commitResult == null) { dbImpl.getEnv().incDeleteFailOps(dbImpl); } return commitResult; } } catch (Error E) { envHandle.invalidate(E); throw E; } finally { locker.operationEnd(commitResult != null); } } /** * Deletes the record associated with the given secondary key. In the * presence of duplicate keys, all primary records associated with the * given secondary key will be deleted. * *

When the primary records are deleted, their associated secondary * records are deleted as if {@link Database#delete} were called. This * includes, but is not limited to, the secondary record referenced by the * given key.

* *

Calling this method is equivalent to calling {@link * #delete(Transaction, DatabaseEntry, WriteOptions)}.

* * @param key the key used as * input. * * */ @Override public OperationStatus delete(final Transaction txn, final DatabaseEntry key) { final OperationResult result = delete(txn, key, null); return result == null ? OperationStatus.NOTFOUND : OperationStatus.SUCCESS; } /** * Moves the cursor to a record according to the specified {@link Get} * type. * *

The difference between this method and the method it overrides in * {@link Cursor} is that the key here is defined as the secondary * records's key, and the data is defined as the primary record's data.

*/ @Override public OperationResult get( final Transaction txn, final DatabaseEntry key, final DatabaseEntry data, final Get getType, ReadOptions options) { return get(txn, key, null, data, getType, options); } /** * Retrieves a record according to the specified {@link Get} type. * *

If the operation succeeds, the record will be locked according to the * {@link ReadOptions#getLockMode() lock mode} specified, the key, primary * key and/or data will be returned via the (non-null) DatabaseEntry * parameters, and a non-null OperationResult will be returned. If the * operation fails because the record requested is not found, null is * returned.

* *

The following table lists each allowed operation and whether the key, * pKey and data parameters are input * or output parameters. See the individual {@link Get} operations for * more information.

* *
* * * * * * * * * * * * * * * * * * * * * *
Get operationDescription'key' parameter'pKey' parameter'data' parameter
{@link Get#SEARCH}Searches using an exact match by key.inputoutputoutput
{@link Get#SEARCH_BOTH}Searches using an exact match by key and data.inputinputoutput
* * @param txn For a transactional database, an explicit transaction may be * specified to transaction-protect the operation, or null may be specified * to perform the operation without transaction protection. For a * non-transactional database, null must be specified. * * @param key the secondary key input parameter. * * @param pKey the primary key input or output parameter, depending on * getType. * * @param data the primary data output parameter. * * @param getType the Get operation type. May not be null. * * @param options the ReadOptions, or null to use default options. * * @return the OperationResult if the record requested is found, else null. * * @throws OperationFailureException if one of the Read Operation * Failures occurs. * * @throws EnvironmentFailureException if an unexpected, internal or * environment-wide failure occurs. * * @throws IllegalStateException if the database has been closed. * * @throws IllegalArgumentException if an invalid parameter is specified. * This includes passing a null getType, a null input key/pKey parameter, * an input key/pKey parameter with a null data array, a partial key/pKey * input parameter, and specifying a {@link ReadOptions#getLockMode() * lock mode} of READ_COMMITTED. * * @since 7.0 */ public OperationResult get( final Transaction txn, final DatabaseEntry key, final DatabaseEntry pKey, final DatabaseEntry data, final Get getType, ReadOptions options) { try { checkEnv(); checkReadable(); if (options == null) { options = Cursor.DEFAULT_READ_OPTIONS; } LockMode lockMode = options.getLockMode(); trace( Level.FINEST, "SecondaryDatabase.get", String.valueOf(getType), txn, key, null, lockMode); checkLockModeWithoutTxn(txn, lockMode); final CursorConfig cursorConfig; if (lockMode == LockMode.READ_COMMITTED) { cursorConfig = READ_COMMITTED_CURSOR_CONFIG; lockMode = null; } else { cursorConfig = DEFAULT_CURSOR_CONFIG; } OperationResult result = null; final Locker locker = LockerFactory.getReadableLocker( this, txn, cursorConfig.getReadCommitted()); try { try (final SecondaryCursor cursor = new SecondaryCursor(this, locker, cursorConfig)) { result = cursor.getInternal( key, pKey, data, getType, options, lockMode); } } finally { locker.operationEnd(result != null); } return result; } catch (Error E) { envHandle.invalidate(E); throw E; } } /** * @param key the secondary key used as input. It must be initialized with * a non-null byte array by the caller. * * @param data the primary data returned as output. Its byte array does * not need to be initialized by the caller. * * */ @Override public OperationStatus get(final Transaction txn, final DatabaseEntry key, final DatabaseEntry data, final LockMode lockMode) { return get(txn, key, new DatabaseEntry(), data, lockMode); } /** * Retrieves the key/data pair with the given key. If the matching key has * duplicate values, the first data item in the set of duplicates is * returned. Retrieval of duplicates requires the use of {@link Cursor} * operations. * *

Calling this method is equivalent to calling {@link * #get(Transaction, DatabaseEntry, DatabaseEntry, DatabaseEntry, Get, * ReadOptions)} with {@link Get#SEARCH}.

* * @param txn For a transactional database, an explicit transaction may be * specified to transaction-protect the operation, or null may be specified * to perform the operation without transaction protection. For a * non-transactional database, null must be specified. * * @param key the secondary key used as * input. * * @param pKey the primary key returned as * output. * * @param data the primary data returned as * output. * * @param lockMode the locking attributes; if null, default attributes are * used. * * @return {@link com.sleepycat.je.OperationStatus#NOTFOUND * OperationStatus.NOTFOUND} if no matching key/data pair is found; * otherwise, {@link com.sleepycat.je.OperationStatus#SUCCESS * OperationStatus.SUCCESS}. * * @throws OperationFailureException if one of the Read Operation * Failures occurs. * * @throws EnvironmentFailureException if an unexpected, internal or * environment-wide failure occurs. * * @throws IllegalStateException if the database has been closed. * * @throws IllegalArgumentException if an invalid parameter is specified. */ public OperationStatus get(final Transaction txn, final DatabaseEntry key, final DatabaseEntry pKey, final DatabaseEntry data, LockMode lockMode) { final OperationResult result = get( txn, key, pKey, data, Get.SEARCH, DbInternal.getReadOptions(lockMode)); return result == null ? OperationStatus.NOTFOUND : OperationStatus.SUCCESS; } /** * This operation is not allowed with this method signature. {@link * UnsupportedOperationException} will always be thrown by this method. * The corresponding method with the pKey parameter should be * used instead. */ @Override public OperationStatus getSearchBoth(final Transaction txn, final DatabaseEntry key, final DatabaseEntry data, final LockMode lockMode) { throw notAllowedException(); } /** * Retrieves the key/data pair with the specified secondary and primary * key, that is, both the primary and secondary key items must match. * *

Calling this method is equivalent to calling {@link * #get(Transaction, DatabaseEntry, DatabaseEntry, DatabaseEntry, Get, * ReadOptions)} with {@link Get#SEARCH_BOTH}.

* * @param txn For a transactional database, an explicit transaction may be * specified to transaction-protect the operation, or null may be specified * to perform the operation without transaction protection. For a * non-transactional database, null must be specified. * * @param key the secondary key used as * input. * * @param pKey the primary key used as * input. * * @param data the primary data returned as * output. * * @param lockMode the locking attributes; if null, default attributes are * used. * * @return {@link com.sleepycat.je.OperationStatus#NOTFOUND * OperationStatus.NOTFOUND} if no matching key/data pair is found; * otherwise, {@link com.sleepycat.je.OperationStatus#SUCCESS * OperationStatus.SUCCESS}. * * @throws OperationFailureException if one of the Read Operation * Failures occurs. * * @throws EnvironmentFailureException if an unexpected, internal or * environment-wide failure occurs. * * @throws IllegalStateException if the database has been closed. * * @throws IllegalArgumentException if an invalid parameter is specified. */ public OperationStatus getSearchBoth(final Transaction txn, final DatabaseEntry key, final DatabaseEntry pKey, final DatabaseEntry data, LockMode lockMode) { final OperationResult result = get( txn, key, pKey, data, Get.SEARCH_BOTH, DbInternal.getReadOptions(lockMode)); return result == null ? OperationStatus.NOTFOUND : OperationStatus.SUCCESS; } /** * This operation is not allowed on a secondary database. {@link * UnsupportedOperationException} will always be thrown by this method. * The corresponding method on the primary database should be used instead. */ @Override public OperationResult put( final Transaction txn, final DatabaseEntry key, final DatabaseEntry data, final Put putType, final WriteOptions options) { throw notAllowedException(); } /** * This operation is not allowed on a secondary database. {@link * UnsupportedOperationException} will always be thrown by this method. * The corresponding method on the primary database should be used instead. */ @Override public OperationStatus put(final Transaction txn, final DatabaseEntry key, final DatabaseEntry data) { throw notAllowedException(); } /** * This operation is not allowed on a secondary database. {@link * UnsupportedOperationException} will always be thrown by this method. * The corresponding method on the primary database should be used instead. */ @Override public OperationStatus putNoOverwrite(final Transaction txn, final DatabaseEntry key, final DatabaseEntry data) { throw notAllowedException(); } /** * This operation is not allowed on a secondary database. {@link * UnsupportedOperationException} will always be thrown by this method. * The corresponding method on the primary database should be used instead. */ @Override public OperationStatus putNoDupData(final Transaction txn, final DatabaseEntry key, final DatabaseEntry data) { throw notAllowedException(); } /** * This operation is not allowed on a secondary database. {@link * UnsupportedOperationException} will always be thrown by this method. * The corresponding method on the primary database should be used instead. */ @Override public JoinCursor join(final Cursor[] cursors, final JoinConfig config) { throw notAllowedException(); } /** * Updates a single secondary when a put() or delete() is performed on the * primary. *

* For an insert, newData will be non-null and oldData will be null. *

* For an update, newData will be non-null and oldData will be non-null. *

* For a delete, newData will be null and oldData may be null or non-null * depending on whether its need by the key creator/extractor. * * @param locker the internal locker. * * @param secCursor secondary cursor to use, or null if this method should * open and close a cursor if one is needed. * * @param priDb is the DB containing the primary record. * * @param priCursor is the cursor positioned on the primary record, or * null if not available. * * @param priKey the primary key. * * @param oldData the primary data before the change, or null if the record * did not previously exist. * * @param newData the primary data after the change, or null if the record * has been deleted. * * @param cacheMode CacheMode to use for accessing secondary. * * @param expirationTime expiration time of primary record, to be written * to secondary records. * * @param expirationUpdated whether the primary was updated and the * expiration time changed. * * @param oldExpirationTime the expiration time of the previous version of * the primary record. When the primary was updated, this is the expiration * time of the previous version. When the primary was not updated, this is * the expiration time of the current or newly inserted primary record. * * @return the number of secondary records written (inserted, deleted or * updated). */ int updateSecondary(final Locker locker, Cursor secCursor, final DatabaseImpl priDb, final CursorImpl priCursor, final DatabaseEntry priKey, final DatabaseEntry oldData, final DatabaseEntry newData, final CacheMode cacheMode, final long expirationTime, final boolean expirationUpdated, final long oldExpirationTime) { final boolean expirationInHours = TTL.isSystemTimeInHours(expirationTime); final int expiration = TTL.systemTimeToExpiration(expirationTime, expirationInHours); final SecondaryKeyCreator keyCreator = secondaryConfig.getKeyCreator(); final SecondaryMultiKeyCreator multiKeyCreator = secondaryConfig.getMultiKeyCreator(); final boolean localCursor = (secCursor == null); if (keyCreator != null) { /* Each primary record may have a single secondary key. */ assert multiKeyCreator == null; /* Get old and new secondary keys. */ DatabaseEntry oldSecKey = null; DatabaseEntry newSecKey = null; if (oldData != null || newData == null) { oldSecKey = new DatabaseEntry(); if (!keyCreator.createSecondaryKey(this, priKey, oldData, oldSecKey)) { oldSecKey = null; } } if (newData != null) { newSecKey = new DatabaseEntry(); if (!keyCreator.createSecondaryKey(this, priKey, newData, newSecKey)) { newSecKey = null; } } /* Delete the old key if it is no longer present. */ final boolean doDelete = oldSecKey != null && !oldSecKey.equals(newSecKey); /* Insert the new key if it was not present before. */ final boolean doInsert = newSecKey != null && !newSecKey.equals(oldSecKey); /* Update secondary if key did not change but expiration did. */ final boolean doUpdate = expirationUpdated && newSecKey != null && !doInsert; if (doDelete || doInsert || doUpdate) { if (localCursor) { secCursor = new Cursor(this, locker, null); } try { if (doDelete) { deleteKey( secCursor, priDb, priCursor, priKey, oldSecKey, cacheMode, oldExpirationTime); } if (doInsert) { insertKey( locker, secCursor, priDb, priCursor, priKey, newSecKey, cacheMode, expiration, expirationInHours, oldExpirationTime); } if (doUpdate) { updateExpiration( secCursor, priDb, priCursor, priKey, oldSecKey, cacheMode, expiration, expirationInHours, oldExpirationTime); } } finally { if (localCursor) { secCursor.close(); } } } return (doDelete ? 1 : 0) + (doInsert ? 1 : 0) + (doUpdate ? 1 : 0); } else { /* Each primary record may have multiple secondary keys. */ if (multiKeyCreator == null) { throw new IllegalArgumentException( "SecondaryConfig.getKeyCreator()/getMultiKeyCreator()" + " may be null only if the primary database is read-only"); } /* Get old and new secondary keys. */ final Set oldKeys; final Set newKeys; if (oldData == null && newData != null) { oldKeys = EMPTY_SET; } else { oldKeys = new HashSet<>(); multiKeyCreator.createSecondaryKeys( this, priKey, oldData, oldKeys); } if (newData == null) { newKeys = EMPTY_SET; } else { newKeys = new HashSet<>(); multiKeyCreator.createSecondaryKeys( this, priKey, newData, newKeys); } final Set toDelete; final Set toInsert; final Set toUpdate; /* Delete old keys that are no longer present. */ if (oldKeys.isEmpty()) { toDelete = EMPTY_SET; } else { toDelete = new HashSet<>(oldKeys); toDelete.removeAll(newKeys); } /* Insert new keys that were not present before. */ if (newKeys.isEmpty()) { toInsert = EMPTY_SET; } else { toInsert = new HashSet<>(newKeys); toInsert.removeAll(oldKeys); } /* Update secondary if key did not change but expiration did. */ if (!expirationUpdated || newKeys.isEmpty()) { toUpdate = EMPTY_SET; } else { toUpdate = new HashSet<>(newKeys); toUpdate.retainAll(oldKeys); } if (!toDelete.isEmpty() || !toInsert.isEmpty() || !toUpdate.isEmpty()) { if (localCursor) { secCursor = new Cursor(this, locker, null); } try { if (!toDelete.isEmpty()) { for (DatabaseEntry secKey : toDelete) { deleteKey( secCursor, priDb, priCursor, priKey, secKey, cacheMode, oldExpirationTime); } } if (!toInsert.isEmpty()) { for (DatabaseEntry secKey : toInsert) { insertKey( locker, secCursor, priDb, priCursor, priKey, secKey, cacheMode, expiration, expirationInHours, oldExpirationTime); } } if (!toUpdate.isEmpty()) { for (DatabaseEntry secKey : toUpdate) { updateExpiration( secCursor, priDb, priCursor, priKey, secKey, cacheMode, expiration, expirationInHours, oldExpirationTime); } } } finally { if (localCursor) { secCursor.close(); } } } return toDelete.size() + toInsert.size() + toUpdate.size(); } } /** * Deletes an old secondary key. */ private void deleteKey(final Cursor secCursor, final DatabaseImpl priDb, final CursorImpl priCursor, final DatabaseEntry priKey, final DatabaseEntry oldSecKey, final CacheMode cacheMode, final long oldExpirationTime) { final OperationResult result = secCursor.search( oldSecKey, priKey, LockMode.RMW, cacheMode, SearchMode.BOTH, false); if (result != null) { secCursor.deleteInternal(getDbImpl().getRepContext(), cacheMode); return; } if (isFullyPopulated && !getEnv().expiresWithin( oldExpirationTime, getEnv().getTtlClockTolerance())) { throw new SecondaryIntegrityException( this, secCursor.getCursorImpl().getLocker(), "Secondary is corrupt: the primary record contains a key " + "that is not present in the secondary", getDatabaseName(), priDb.getName(), oldSecKey, priKey, CursorImpl.getCurrentLsn(priCursor), oldExpirationTime, EnvironmentImpl.getExtinctionStatus(priDb, priKey)); } } /** * Inserts a new secondary key. */ private void insertKey(final Locker locker, final Cursor cursor, final DatabaseImpl priDb, final CursorImpl priCursor, final DatabaseEntry priKey, final DatabaseEntry newSecKey, final CacheMode cacheMode, final int expiration, final boolean expirationInHours, final long oldExpirationTime) { /* Check for the existence of a foreign key. */ final Database foreignDb = secondaryConfig.getForeignKeyDatabase(); if (foreignDb != null) { try (final Cursor foreignCursor = new Cursor(foreignDb, locker, null)) { final DatabaseEntry tmpData = new DatabaseEntry(); final OperationResult result = foreignCursor.search( newSecKey, tmpData, LockMode.DEFAULT, cacheMode, SearchMode.SET, true); if (result == null) { throw new ForeignConstraintException( locker, "Secondary " + getDatabaseName() + " foreign key not allowed: it is not" + " present in the foreign database " + foreignDb.getDatabaseName(), getDatabaseName(), priDb.getName(), newSecKey, priKey, CursorImpl.getCurrentLsn(priCursor), oldExpirationTime, EnvironmentImpl.getExtinctionStatus(priDb, priKey)); } } } final ExpirationInfo expInfo = new ExpirationInfo( expiration, expirationInHours, false /*updateExpiration*/); /* Insert the new key. */ if (configuration.getSortedDuplicates()) { final OperationResult result = cursor.putInternal( newSecKey, priKey, cacheMode, expInfo, PutMode.NO_DUP_DATA); if (result == null && isFullyPopulated) { throw new SecondaryIntegrityException( this, locker, "Secondary/primary record already present", getDatabaseName(), priDb.getName(), newSecKey, priKey, CursorImpl.getCurrentLsn(priCursor), oldExpirationTime, EnvironmentImpl.getExtinctionStatus(priDb, priKey)); } } else { final OperationResult result = cursor.putInternal( newSecKey, priKey, cacheMode, expInfo, PutMode.NO_OVERWRITE); if (result == null && isFullyPopulated) { throw new UniqueConstraintException( locker, "Unique secondary key is already present", getDatabaseName(), priDb.getName(), newSecKey, priKey, CursorImpl.getCurrentLsn(priCursor), oldExpirationTime, EnvironmentImpl.getExtinctionStatus(priDb, priKey)); } } } /** * Updates a new secondary key, which doesn't change the key or data but is * needed to update the expiration time. */ private void updateExpiration(final Cursor cursor, final DatabaseImpl priDb, final CursorImpl priCursor, final DatabaseEntry priKey, final DatabaseEntry secKey, final CacheMode cacheMode, final int expiration, final boolean expirationInHours, final long oldExpirationTime) { final PutMode putMode; final ExpirationInfo expInfo = new ExpirationInfo( expiration, expirationInHours, true /*updateExpiration*/); final EnvironmentImpl envImpl = getEnv(); if (isFullyPopulated && !envImpl.expiresWithin( oldExpirationTime, envImpl.getTtlClockTolerance())) { final OperationResult result = cursor.search( secKey, priKey, LockMode.RMW, cacheMode, configuration.getSortedDuplicates() ? SearchMode.BOTH : SearchMode.SET, false); if (result == null) { throw new SecondaryIntegrityException( this, cursor.getCursorImpl().getLocker(), "Secondary is corrupt: the primary record contains a " + "key that is not present in the secondary", getDatabaseName(), priDb.getName(), secKey, priKey, CursorImpl.getCurrentLsn(priCursor), oldExpirationTime, EnvironmentImpl.getExtinctionStatus(priDb, priKey)); } putMode = PutMode.CURRENT; } else { putMode = PutMode.OVERWRITE; } cursor.putInternal(secKey, priKey, cacheMode, expInfo, putMode); } /** * Called when a record in the foreign database is deleted. * * @param secKey is the primary key of the foreign database, which is the * secondary key (ordinary key) of this secondary database. */ void onForeignKeyDelete(final Locker locker, final DatabaseEntry secKey, final CacheMode cacheMode) { final ForeignKeyDeleteAction deleteAction = secondaryConfig.getForeignKeyDeleteAction(); /* Use RMW if we're going to be deleting the secondary records. */ final LockMode lockMode = (deleteAction == ForeignKeyDeleteAction.ABORT) ? LockMode.DEFAULT : LockMode.RMW; /* * Use the deleted foreign primary key to read the data of this * database, which is the associated primary's key. */ try (final Cursor cursor = new Cursor(this, locker, null)) { final DatabaseEntry priKey = new DatabaseEntry(); OperationResult secResult = cursor.search( secKey, priKey, lockMode, cacheMode, SearchMode.SET, true); while (secResult != null) { if (deleteAction == ForeignKeyDeleteAction.ABORT) { /* * ABORT - throw an exception to cause the user to abort * the transaction. */ final Database primaryDb = getPrimary(priKey); final String priDbName = (primaryDb != null) ? primaryDb.getDatabaseName() : "unknown"; throw new DeleteConstraintException( locker, "Secondary refers to a deleted foreign key", getDatabaseName(), priDbName, secKey, priKey, DbLsn.NULL_LSN, secResult.getExpirationTime(), null); } else if (deleteAction == ForeignKeyDeleteAction.CASCADE) { /* * CASCADE - delete the associated primary record. */ final Database primaryDb = getPrimary(priKey); if (primaryDb != null) { final OperationResult priResult = primaryDb.deleteInternal( locker, priKey, cacheMode); if (priResult == null && !cursor.cursorImpl.isProbablyExpired()) { throw secondaryRefersToMissingPrimaryKey( locker, primaryDb, secKey, priKey, secResult.getExpirationTime()); } } } else if (deleteAction == ForeignKeyDeleteAction.NULLIFY) { /* * NULLIFY - set the secondary key to null in the * associated primary record. */ final Database primaryDb = getPrimary(priKey); if (primaryDb != null) { try (final Cursor priCursor = new Cursor( primaryDb, locker, null)) { final DatabaseEntry data = new DatabaseEntry(); final OperationResult priResult = priCursor.search( priKey, data, LockMode.RMW, cacheMode, SearchMode.SET, true); if (priResult == null) { if (!cursor.cursorImpl.isProbablyExpired()) { throw secondaryRefersToMissingPrimaryKey( locker, primaryDb, secKey, priKey, secResult.getExpirationTime()); } continue; } final ForeignMultiKeyNullifier multiNullifier = secondaryConfig.getForeignMultiKeyNullifier(); if (multiNullifier != null) { if (multiNullifier.nullifyForeignKey( this, priKey, data, secKey)) { priCursor.putCurrent(data); } } else { final ForeignKeyNullifier nullifier = secondaryConfig.getForeignKeyNullifier(); if (nullifier.nullifyForeignKey(this, data)) { priCursor.putCurrent(data); } } } } } else { /* Should never occur. */ throw EnvironmentFailureException.unexpectedState(); } secResult = cursor.retrieveNext( secKey, priKey, LockMode.DEFAULT, cacheMode, GetMode.NEXT_DUP); } } } /** * If either ImmutableSecondaryKey or ExtractFromPrimaryKeyOnly is * configured, an update cannot change a secondary key. * ImmutableSecondaryKey is a guarantee from the user meaning just that, * and ExtractFromPrimaryKeyOnly also implies the secondary key cannot * change because it is derived from the primary key which is immutable * (like any other key). */ boolean updateMayChangeSecondary() { return !secondaryConfig.getImmutableSecondaryKey() && !secondaryConfig.getExtractFromPrimaryKeyOnly(); } /** * When false is returned, this allows optimizing for the case where a * primary update operation can update secondaries without reading the * primary data. */ static boolean needOldDataForUpdate( final Collection secondaries) { if (secondaries == null) { return false; } for (final SecondaryDatabase secDb : secondaries) { if (secDb.updateMayChangeSecondary()) { return true; } } return false; } /** * When false is returned, this allows optimizing for the case where a * primary delete operation can update secondaries without reading the * primary data. */ static boolean needOldDataForDelete( final Collection secondaries) { if (secondaries == null) { return false; } for (final SecondaryDatabase secDb : secondaries) { if (!secDb.secondaryConfig.getExtractFromPrimaryKeyOnly()) { return true; } } return false; } /* A secondary DB has no secondaries of its own, by definition. */ @Override boolean hasSecondaryOrForeignKeyAssociations() { return false; } /** * Utility to call SecondaryAssociation.getPrimary. * * Handles exceptions and does an important debugging check that can't be * done at database open time: ensures that the same SecondaryAssociation * instance is used for all associated DBs. *

* Returns null if getPrimary returns null, so the caller must handle this * possibility. Null normally means that a secondary read operation can * skip the record. */ Database getPrimary(DatabaseEntry priKey) { final Database priDb; try { priDb = secAssoc.getPrimary(priKey); } catch (RuntimeException e) { throw EnvironmentFailureException.unexpectedException( "Exception from SecondaryAssociation.getPrimary", e); } if (priDb == null) { return null; } if (priDb.secAssoc != secAssoc) { throw new IllegalArgumentException( "Primary and secondary have different SecondaryAssociation " + "instances. Remember to configure the SecondaryAssociation " + "on the primary database."); } return priDb; } private DatabaseImpl checkReadable() { final DatabaseImpl dbImpl = checkOpen(); if (!isFullyPopulated) { throw new IllegalStateException( "Incremental population is currently enabled."); } return dbImpl; } static UnsupportedOperationException notAllowedException() { return new UnsupportedOperationException( "Operation not allowed on a secondary"); } /** * Send trace messages to the java.util.logger. Don't rely on the logger * alone to conditionalize whether we send this message, we don't even want * to construct the message if the level is not enabled. */ void trace(final Level level, final String methodName) { if (logger.isLoggable(level)) { StringBuilder sb = new StringBuilder(); sb.append(methodName); sb.append(" name=").append(getDatabaseName()); sb.append(" primary=").append(primaryDatabase.getDatabaseName()); LoggerUtils.logMsg( logger, getEnv(), level, sb.toString()); } } }





© 2015 - 2024 Weber Informatics LLC | Privacy Policy