Monitor node, environment handle and Berkely DB - NoSQL Database

Hi all,
Monitor nodes exist in Berkeley DB. Do they exist in Oracle NoSQL ?
Environment handles exist in Berkeley DB. Do they exist in Oracle NoSQL ?
Thanks. 

user962305 wrote:
Hi all,
Monitor nodes exist in Berkeley DB. Do they exist in Oracle NoSQL ?
Environment handles exist in Berkeley DB. Do they exist in Oracle NoSQL ?By monitor nodes, I assume you mean HA Monitors? They are used in Oracle NoSQL as part of the implementation, but they are not a user visible entity.
Charles Lamb 

To add to Charles' reply: Monitor nodes are used in Berkeley DB Java Edition to let the application find the master of a replication group. The application is responsible for directing write operations to the master node. With Oracle NoSQL DB, write operation dispatching is handled by NoSQL DB, so the application does not need to use monitors.

Related

What are the differences between Oracle and other NoSQL database

Hi all,
I would like to know what the differences between Oracle and other NoSQL database are.
When and why should we use Oracle?
Is Oracle NoSQL database link with Big Data Appliance?
Can we use map-reduce on a single personal computer? How should we install Oracle NoSQL database to use map reduce on a single personal computer?
Do we also have eventual consistency with Oracle NoSQL database? Can we lose data if master node fails?
Are transactions ACID with Oracle NoSQL database? How can we prove it?
Thanks. 
893771 wrote:
Hi all,
I would like to know what the differences between Oracle and other NoSQL database are.
When and why should we use Oracle?I suggest that you start here:
http://www.oracle.com/technetwork/database/nosqldb/overview/index.html
Is Oracle NoSQL database link with Big Data Appliance?Yes, Oracle NoSQL Database will be a component of the Big Data Appliance.
Can we use map-reduce on a single personal computer? How should we install Oracle NoSQL database to use map reduce on a single personal computer?Yes, I believe you can run M/R on a single computer. Consult the various pieces of documentation available on the web. You may run Oracle NoSQL Database on the same computer that you are running M/R on, but it is likely that they will compete for CPU and IO resources and therefore performance may suffer.
Do we also have eventual consistency with Oracle NoSQL database? Yes.
Can we lose data if master node fails?If you run Oracle NoSQL Database with the default (recommended) durability settings, then if the master fails, a new one will be elected and data is not lost.
Are transactions ACID with Oracle NoSQL database? How can we prove it?Yes, each operation is executed in an ACID transaction. The API has the concept of "multi" operations which allow the caller to perform multiple operations on sets of records with the same major key, but different minor keys. Those operations are also performed within a transaction.
Charles Lamb

MAP/REDUCE and Oracle NoSQL

Hi all,
I would like to know if there are some examples on how to run run map/reduce with Oracle NoSQL.
Is there any source code any where? Can you send me one example?
Where can we download all the necessary tools?
In Oracle Big Data Appliance is map/reduce used with Oracle NoSQL or with Hadoop?
Thanks 
user962305 wrote:
I would like to know if there are some examples on how to run run map/reduce with Oracle NoSQL.
Is there any source code any where? Can you send me one example?Take a look in the oracle.kv.hadoop.KVInputFormat javadoc. It discusses how to use Oracle NoSQL Database with Hadoop as well as referring to an example which is included in the distribution.
Where can we download all the necessary tools?
In Oracle Big Data Appliance is map/reduce used with Oracle NoSQL or with Hadoop?It would be used with both, whether or not you were on the BDA. You use the KVInputFormat to read data from Oracle NoSQL Database into Hadoop during map/reduce processing.
I hope this is useful.
Charles Lamb 
Hi Charles,
Can you please, explain where and what to download and install for this case?
Should we also install hadoop on the same replication nodes as Oracle NoSQL?
Is it possible to have an example with pre-loaded keys on Oracle NoSQL to perform the test?
Is there a version of Oracle NoSQL which comes with some key/value pairs?
I understand the following. Data in Oracle NoSQL will be loaded in hadoop first and then map/reduce is performed in haddop. Is it right?
I would like to know: Does that mean Oracle NoSQL can not run parallel operations? What is the aim in loading data to hadoop first if Oracle is able do perform parallel operations? Loading data from Oracle NoSQL to hadoop may take enormous time I suppose.
Thanks 
user962305 wrote:
Can you please, explain where and what to download and install for this case?Download [Oracle NoSQL Database from OTN|http://www.oracle.com/technetwork/database/nosqldb/downloads/index.html] .
Should we also install hadoop on the same replication nodes as Oracle NoSQL?It depends on your access patterns. In general, probably not, but there may be cases where you achieve better performance with Hadoop and the Rep Nodes co-located.
Is it possible to have an example with pre-loaded keys on Oracle NoSQL to perform the test?
Is there a version of Oracle NoSQL which comes with some key/value pairs?Look at the quickstart guide that comes with the above Oracle NoSQL Database package. There is a small HelloWorld example which you can use as the basis for creating a data set.
I understand the following. Data in Oracle NoSQL will be loaded in hadoop first and then map/reduce is performed in haddop. Is it right?Hadoop is a framework, which among other things happens to run Map/Reduce jobs. Your Map/Reduce job would use the KVInputFormat to read data from Oracle NoSQL Database and process it however it sees fit. It might write the output of the M/R to (say) HDFS. Or it might write it to (say) Oracle RDBMS. Or it might write it back to (say) Oracle NoSQL Database.
>
I would like to know: Does that mean Oracle NoSQL can not run parallel operations? What is the aim in loading data to hadoop first if Oracle is able do perform parallel operations? Loading data from Oracle NoSQL to hadoop may take enormous time I suppose.I am not sure I understand your question. Hadoop, by its nature will break a job into many subtasks. Those subtasks run in parallel, generally across many Hadoop nodes. Those subtasks may access Oracle NoSQL Database data. Hence, Oracle NoSQL Database is able to perform operations in parallel either on the same or different Rep Nodes.
Charles Lamb 
Thanks Charles.
For hadoop, where and which version should we used for Oracle NoSQL ? 
I think 0.2.20 is the current, no?
Charles Lamb

GoldenGate and JavaDB (Derby db)

Hello,
I would like to know if GoldenGate supports replication from Oracle dbs to Javadbs (old named was Derby). In particular is the version of Javadb 10 10.6.2.1 provided with Glassfish 3.1.1 supported and with which version of Golden gate?
Extra question: is it possible to set the replication one way instead of both way? I would need data to get replicated only one way from central Oracle database to a multiitude of javaDB databases.
Any documentation on this?
Other alternative than Godengate?
Thanks 
user553981 wrote:
Hello, I would like to know if GoldenGate supports replication from Oracle dbs to Javadbs (old named was Derby). Java DB is not supported as a source nor a target for GoldenGate. It's possible that ODI (Oracle Data Integrator) might be able to do what you're looking for.
Extra question: is it possible to set the replication one way instead of both way? I would need data
to get replicated only one way from central Oracle database to a multiitude of javaDB databases.GoldenGate by default is one-way replication; two-way replication is just a matter of setting up the same configuration in the other direction. You can set up data-capture from Oracle DB, and possibly (not trivially) use the Java API to take these change-events and apply them via your own JDBC implementation to Java DB. (Again, that's a bit of a project. This is not out-of-the-box functionality.)
Any documentation on this?The OGG Java API (aka the Java user-exit) is =>
* http://docs.oracle.com/cd/E18101_01/index.htm
* http://www.oracle.com/technetwork/middleware/goldengate/documentation/index.html
More likely you'll want to look at ODI =>
* http://www.oracle.com/technetwork/middleware/data-integrator/overview/index.html
* Data Integrator
I believe you can also use GG via ODI to capture changes from Oracle, and then use ODI to deliver the change events via JDBC to Java DB... but I'm not positive about that. (You might want to check in the ODI forum.)
Cheers,
-Mike

GoldenGate for DB

Hi experts,we have a replication requirement between oracle to DB2 database,  please help on this, can we use data transformation like mapping and filtering in goldengate between oracle to DB2 databases?  and the actual requirment is, there is 5 tables in source oracle database and some of the fields values from that 5 tables needs to replicat to single DB2 table  , is it possible in goldengate? kindly help on this.thanks in Advance.
902923 wrote:
 
Hi experts,
we have a replication requirement between oracle to DB2 database,  please help on this, can we use data transformation like mapping and filtering in goldengate between oracle to DB2 databases?  and the actual requirment is, there is 5 tables in source oracle database and some of the fields values from that 5 tables needs to replicat to single DB2 table  , is it possible in goldengate? kindly help on this.
thanks in Advance.
 Yes, GoldenGate allows "heterogeneous" data replication; the source & targets can be any combination of (supported) databases on any (supported) platform. For instance, data capture from Oracle w/ replication to DB2 and/or MySQL and/or SQL Server... Or, data capture on DB2 and replication to Oracle (or MySQL or SQL Server, etc).  As far as GG is concerned, the "flavor" of the source & target system is largely irrelevant; there are only a few special considerations, e.g., you'll need a "source" definitions file & separate "target" definitions (instead of using "assumeTargetDefs"), and there are a few more features for Oracle-to-Oracle replication (e.g., DDL replication). But table/column mapping & filtering are certainly allowed for heterogeneous database replication.
Thanks a lot Mike,  Can you please confirm the below points that would be great help to start, 1. Is it possible to do the bi directional replication between oracle to mainframe DB2 databases with filtering and mapping? is there any additional steps required for this? 2. For Bi directional replication between oracle to mainframe DB2 ,  need to create definition file for both oracle and DB2 databases and transfer to each side is it right? 3. Also , we can find profile check script for db2 database for linux, unix. and aix in MOS but can't execute the same script on mainframe environment , is there any separate script available for mainframe DB2 environment?  Thanks in advance. 
902923 wrote:
 
Thanks a lot Mike,  Can you please confirm the below points that would be great help to start,
1. Is it possible to do the bi directional replication between oracle to mainframe DB2 databases with filtering and mapping? is there any additional steps required for this?
2. For Bi directional replication between oracle to mainframe DB2 ,  need to create definition file for both oracle and DB2 databases and transfer to each side is it right?
3. Also , we can find profile check script for db2 database for linux, unix. and aix in MOS but can't execute the same script on mainframe environment , is there any separate script available for mainframe DB2 environment?
 
Thanks in advance.
  Yes, bi-directional is possible in a heterogeneous replication scenario, with filtering, mapping, etc; see the topic in the docs on "bidirectional replication". The main point to consider is avoiding "loops", so that replicated data isn't re-replicated. The means by which each DB handles this is different; in some cases, data replicated by GG is automatically detected (e.g., via a trace table) or by ignoring changes applied by a designated user that just does replication (i.e., "excludeUser").  See the GoldenGate guide section on "preventing data looping".  Data definition files would have to be created on each side, yes, and copied to the "other" side. For scripts used for checking the database before using GG, you probably should check with Support for the latest; I can't say for sure. For DB2 on z/OS (which is usually what "DB2 on mainframe means), you'd use Unix System Services to run GoldenGate, which provides the same ksh/bash shell environment as other linux/unix (aix, et al) environments for executing shell scripts.  (But do check with support for your options here.)

Goldengate database level replication.. possible?

Hi all ,I have a test case.Is it possible to replicate whole database from using Golden Gate ? I dont want to replicate a particular schema.Suppose i have 3 db server. and in any of them the schemas will be created randomly and want them to be replicated into all every node's databases,Is it possible?Any kind of help would be appreciated.
Hi , Using Oracle GoldenGate  Database Level replication is not possible. Oracle GoldenGate is a best-of-breed, easy-to-deploy product used to replicate and integrate transactional data with subsecond speed among a variety of enterprise systems. Oracle GoldenGate provides the flexibility to move data between like-to-like and heterogeneous systems, including different versions of Oracle Database, different hardware platforms, and between Oracle and non-Oracle databases including Microsoft SQL Server, IBM DB2 for open systems and z/OS, Sybase, and more. Regards,Veera

Categories

Resources