Welcome, Guest: Register On Nairaland / LOGIN! / Trending / Recent / New
Stats: 3,143,328 members, 7,780,824 topics. Date: Thursday, 28 March 2024 at 11:25 PM

Nosql, SQL And Newsql Database: Share Your Experience. - Programming - Nairaland

Nairaland Forum / Science/Technology / Programming / Nosql, SQL And Newsql Database: Share Your Experience. (1578 Views)

Relational Database Vs Nosql Database. / Share Your Gdevit.com Experience Here! All Trolls, Bots etc - stay out!! / What Made You Want To Learn Programming? Share Your Story (2) (3) (4)

(1) (Reply) (Go Down)

Nosql, SQL And Newsql Database: Share Your Experience. by guru01(m): 9:50am On Jun 20, 2016
Hello masters and administrators of Database, please share your experience with these technologies for others to learn and make the right choice when shopping for database to use in developing various type of app.
Re: Nosql, SQL And Newsql Database: Share Your Experience. by refiner(f): 9:55am On Jun 20, 2016
guru01:
Hello masters and administrators of Database, please share your experience with these technologies for others to learn and make the right choice when shopping for database to use in developing various type of app.

Please vote for me for miss Nairaland smiley
Re: Nosql, SQL And Newsql Database: Share Your Experience. by Nobody: 9:55am On Jun 20, 2016
*Spreads mat* waiting for the maestros. . .
Re: Nosql, SQL And Newsql Database: Share Your Experience. by guru01(m): 10:08am On Jun 20, 2016
refiner:


Please vote for me for miss Nairaland smiley
I will vote for you if you tell me the difference between these technologies.
Re: Nosql, SQL And Newsql Database: Share Your Experience. by refiner(f): 10:16am On Jun 20, 2016
guru01:

I will vote for you if you tell me the difference between these technologies.

Haba, i just finished High school na cry

But i know that SQL is Structured Query language an interactive programming language, used in querying a database

Oracle12g is also used for database...

Another ones are modifications, like we have Java, Python and C#

Thats how i understood it ooo... Pls na smiley
Re: Nosql, SQL And Newsql Database: Share Your Experience. by guru01(m): 10:17am On Jun 20, 2016
@dhtml18
@pcguru1
@fincoapps
@raypawer
@javanian
@fulaman198
@dgurudoer
@fatimahzahra
Re: Nosql, SQL And Newsql Database: Share Your Experience. by Nobody: 10:36am On Jun 20, 2016
guru01:
Hello masters and administrators of Database, please share your experience with these technologies for others to learn and make the right choice when shopping for database to use in developing various type of app.

I will be honest i have only used SQL Server and MySQL and no experience with NoSQL so i don't really know the criteria for picking NoSQL it's hard for me to think in a non-relational relationship i guess.

1 Like

Re: Nosql, SQL And Newsql Database: Share Your Experience. by guru01(m): 11:00am On Jun 20, 2016
pcguru1:


I will be honest i have only used SQL Server and MySQL and no experience with NoSQL so i don't really know the criteria for picking NoSQL it's hard for me to think in a non-relational relationship i guess.
Share your experience with sql.
Re: Nosql, SQL And Newsql Database: Share Your Experience. by Raypawer(m): 5:51pm On Jun 20, 2016
hmm, this one oga d spread mat,

dhtml18:
*Spreads mat* waiting for the maestros. . .

I have a superb experience using MSSQL, but in case of a realtime app, going mean ( Mongo, Express, Angular, Node) is the way, as it spreads json all round, The none relational way of Mongo is amazing though hav not created any personal app with mongo
Re: Nosql, SQL And Newsql Database: Share Your Experience. by guru01(m): 9:18pm On Jun 20, 2016
Raypawer:
hmm, this one oga d spread mat,



I have a superb experience using MSSQL, but in case of a realtime app, going mean ( Mongo, Express, Angular, Node) is the way, as it spreads json all round, The none relational way of Mongo is amazing though hav not created any personal app with mongo
Thanks for your response, but its better you tell us what you know base on experience.
I like to know more about mssql. Can it be used with other language effectively (without limitation) and not just .net product.
How many thousand rows has your app gotten to so far, and how well does it perform.
Re: Nosql, SQL And Newsql Database: Share Your Experience. by guru01(m): 9:19pm On Jun 20, 2016
dhtml18:
*Spreads mat* waiting for the maestros. . .
Your experience is highly required.
Re: Nosql, SQL And Newsql Database: Share Your Experience. by guru01(m): 9:26pm On Jun 20, 2016
If you are happy with the performance, scalability, and high availability of your current traditional SQL database system (the likes of Oracle, SQL Server, MySQL), then there is no reason to read further. However, if you have growing pains in any of these areas, then a NoSQL or NewSQL offering may be right for you. So how do you choose between them?

Choosing the right tool for the job at hand is 80% of getting to a solution; the other 20% is really understanding the problem you’re trying to solve. Here’s a rundown of the advantages and disadvantages of traditional SQL databases (affectionately called OldSQL in this article), NoSQL and NewSQL that can help you focus your data store choices.

OLDSQL

Traditional SQL databases have been around for decades and serve as the core foundation of nearly every application we use today. If you have a deployed application and it is behaving and performing acceptably, that is fantastic; there is no need to change your data store. Realize that porting or replacing your database not only introduces work, it introduces risk. It is rare that a database replacement candidate is feature-for-feature, as well as bug-for-bug, compatible with the database you are replacing. Beware any vendor who suggests otherwise! Here are some of the typical patterns of a traditional database application:

THE OLDSQL ADVANTAGES:

Proven disk-based database technology and standard SQL support, hardened over several decades.
Compatible with ORM layers, such as Hibernate or ActiveRecord.
Rich client-side transactions.
Ad hoc query and reporting.
An established market and ecosystem with vast amounts of standards-based tooling.
THE OLDSQL DISADVANTAGES:

Not a scale-out architecture. Transactional throughput is often gated by the capacity of a single machine. Scaling out requires application-defined and managed sharding (or partitioning) of the data.
Traditional SQL systems were built for “one size fits all.” They are good for general purpose applications with modest performance requirements, but struggle as needs grow.
Complex tuning parameters often require deep expertise to get the best balance between performance, data safety, and resource use.
NOSQL

First, realize that the term NoSQL is about as descriptive as categorizing dogs and horses as “NoCats”. In truth, NoSQL is a broad category collecting disparate technologies beneath an ambiguous umbrella. The term offers little help to the developer trying to decide on the right tool for the right job.

So let’s break it down with an eye on what we really care about as software engineers: what problems can I solve with NoSQL? Equally important, where is NoSQL a bad fit? Where do the different technologies show their strengths?

SOME NOSQL SYSTEMS PUT AVAILABILITY FIRST

Say you have gigabytes to petabytes of data. New data is added regularly and, once added, is relatively static. A database that archives sensor readings or ad impression displays is a good example. You want to store this in a cloud and are willing to tolerate the programming challenges of eventual consistency (made easier because most updates are idempotent anyway) for distributed access, multi-datacenter replication, and the highest possible availability.

Your application-to-database interactions are simple “CREATE” and “GET” patterns that don’t require traditional transactions. The most important consideration is that the database is always available to accept new content and can always provide content when queried, even if that content is not the most recent version written. Such systems include DynamoDB, Riak and Cassandra.

SOME NOSQL SYSTEMS FOCUS ON FLEXIBILITY

Made famous by MongoDB and CouchDB, the Document Model expands upon the traditional key-value store by replacing the values with JSON-structured documents, each able to contain sub-keys and sub-values, arrays of value, or hierarchies of all of the above. Often described as schemaless, these systems don’t enforce premeditated or consistent schema across all of the stored documents. This makes managing schema different… less rigid, but also much messier. It is likely the benefits of this approach are more applicable for smaller development teams with simpler data needs.

Other systems expand upon key-value stores with organizational features. Redis is popular for creating many sorted lists of data for easy ranking and leaderboards. By adding more complex functions to order by and computer statistics on, its focus allows for functionality key to its specific use cases.

SOME NOSQL SYSTEMS FOCUS ON ALTERNATIVE DATA MODELS OR SPECIAL USE CASES

The most common examples are systems tuned for graph processing, such as Neo4j. Array databases are another such example; SciDB uses Python and R to access MPP array data for scientific research. Accumulo is a variation on the wide-column-store model popularized by Cassandra and BigTable, but with a focus on cell-level security. Systems like etcd are distributed datastores with a focus on storing configuration data for other services. Elasticsearch is a popular system for implementing text search within applications.

THE NOSQL ADVANTAGES:

Eventual-consistency algorithms allow implementations to deliver the highest availability across multiple data centers.
Eventual-consistency based systems scale update workloads better than traditional
OLAP RDBMs, while also scaling to very large datasets.
Many NoSQL systems are optimized to support non-relational data, such as log messages, XML and JSON documents, as well as unstructured documents, allowing you to skip specifying schema-on-write, and allowing you to specify a schema-on-read.
THE NOSQL DISADVANTAGES:

These systems are fundamentally not transactional (ACID). If they advertise otherwise, beware the over-reaching claim.
OLAP-style queries require a lot of application code. While the write-scaling advantages are appealing vs. OLAP stores (such as Vertica or GreenPlum), you sacrifice declarative ad hoc queries – important to historical analytical exploration.
NEWSQL

The term NewSQL is not quite as broad as NoSQL. NewSQL systems all start with the relational data model and the SQL query language, and they all try to address some of the same sorts of scalability, inflexibility or lack-of-focus that has driven the NoSQL movement. Many offer stronger consistency guarantees.

But within this group there are many differences. HANA was created to be a business reporting powerhouse that could also handle a modest transactional workload, a perfect fit for SAP deployments. Hekaton adds sophisticated in-memory processing to the more traditional Microsoft SQL Server. Both systems are non-clustering for now, and both are designed to replace or enhance OldSQL deployments directly.

NuoDB set out to be a cluster-first SQL database with a focus on cloud-ops: run on many nodes across many datacenters and let the underlying system manage data locality and consistency for you. This comes at a cost in performance and consistency for arbitrary workloads. For workloads that are closer to key-value, global data management is a more tractable problem. NuoDB is the closest to being called eventually consistent of the NewSQL systems.

Other systems focus on clustered analytics, such as MemSQL. Distributed, with MySQL compatibility, MemSQL often offers faster OLAP analytics than all-in-one OldSQL systems, with higher concurrency and the ability to update data as it’s being analyzed.

VoltDB, the most mature of these systems, combines streaming analytics, strong ACID guarantees and native clustering. This allows VoltDB to be the system-of-record for data-intensive applications, while offering an integrated high-throughput, low-latency ingestion engine. It’s a great choice for policy enforcement, fraud/anomaly detection, or other fast-decisioning apps.

THE NEED FOR SPEED: FAST IN-MEMORY SQL

Perhaps you have gigabytes to terabytes of data that needs high-speed transactional access. You have an incoming event stream (think sensors, mobile phones, network access points) and need per-event transactions to compute responses and analytics in real time. Your problem follows a pattern of “ingest, analyze, decide,” where the analytics and the decisions must be calculated per-request and not post-hoc in batch processing. NewSQL systems that offer the scale of NoSQL with stronger consistency may be the right choice.

THE NEWSQL ADVANTAGES:

Minimize application complexity stronger consistency and often full transactional support.
Familiar SQL and standard tooling.
Richer analytics leveraging SQL and extensions.
Many systems offer NoSQL-style clustering with more traditional data and query models.
THE NEWSQL DISADVANTAGES:

No NewSQL systems are as general-purpose as traditional SQL systems set out to be.
In-memory architectures may be inappropriate for volumes exceeding a few terabytes.
Offers only partial access to the rich tooling of traditional SQL systems.
SUMMING IT UP

As a general rule of thumb, consider evaluating NoSQL offerings if you favor availability or have special data model needs. Consider NewSQL if you’d like the at-scale speed of NoSQL, but with stronger consistency and the familiar and powerful SQL query language.

The froth in the data management space is substantial – and our tendency to talk in terms of categories (SQL, NoSQL, NewSQL) vs. problems makes it hard for software developers to understand what’s in the toolbox. The current offerings of new databases are not all alike – and recognizing how the DNA behind each helps or hinders problem solvers is the key to choosing the best solution.

1 Like

Re: Nosql, SQL And Newsql Database: Share Your Experience. by guru01(m): 8:40am On Jun 21, 2016
Wow, its so unusual for all to avoid this topic or is it that we no longer use database in our project.
Re: Nosql, SQL And Newsql Database: Share Your Experience. by Nobody: 9:04am On Jun 21, 2016
[s]Even trolls (like me) avoid topics like this for obvious reasons.[/s]
Somebody like dhtml18 needs to break the ice before other commenters can talk. . . .but alas, my goat has gone missing again
Re: Nosql, SQL And Newsql Database: Share Your Experience. by guru01(m): 9:36am On Jun 21, 2016
dhtml18:
[s]Even trolls (like me) avoid topics like this for obvious reasons.[/s]
Somebody like dhtml18 needs to break the ice before other commenters can talk. . . .but alas, my goat has gone missing again
I see, you mean without your goat you are not contributing?
Re: Nosql, SQL And Newsql Database: Share Your Experience. by Nobody: 9:41am On Jun 21, 2016
guru01:

I see, you mean without your goat you are not contributing?
Of course, are you surprised? been busy revamping Nairaland after people like you don abuse me tire. Nairaland 2.0 is now out.
Re: Nosql, SQL And Newsql Database: Share Your Experience. by guru01(m): 10:09am On Jun 21, 2016
dhtml18:

Of course, are you surprised? been busy revamping Nairaland after people like you don abuse me tire. Nairaland 2.0 is now out.
What's the URL.
Re: Nosql, SQL And Newsql Database: Share Your Experience. by FincoApps(m): 8:19pm On Jun 22, 2016
guru01:
@dhtml18
@pcguru1
@fincoapps
@raypawer
@javanian
@fulaman198
@dgurudoer
@fatimahzahra

It's like you are a database admin ?
Re: Nosql, SQL And Newsql Database: Share Your Experience. by guru01(m): 11:32pm On Jun 22, 2016
FincoApps:


It's like you are a database admin ?
No categorically, but have worked with several dbs extensively.
Re: Nosql, SQL And Newsql Database: Share Your Experience. by VocalWalls: 4:42pm On Jun 25, 2016
please help me vote on this thread...

https://www.nairaland.com/3186985/miss-nairaland-contest-2016-grand

just put

I vote lanicky cc NLjega

thanks.



hollyfat(m), CALEB65

(1) (Reply)

Create A Beautiful Android Weather App Using Openweathermap API / See As This Programmer Murdered His Fellow Programmer... Chai! / What you need to know about Data Analytics And Data Science

(Go Up)

Sections: politics (1) business autos (1) jobs (1) career education (1) romance computers phones travel sports fashion health
religion celebs tv-movies music-radio literature webmasters programming techmarket

Links: (1) (2) (3) (4) (5) (6) (7) (8) (9) (10)

Nairaland - Copyright © 2005 - 2024 Oluwaseun Osewa. All rights reserved. See How To Advertise. 45
Disclaimer: Every Nairaland member is solely responsible for anything that he/she posts or uploads on Nairaland.