Overview of Database Programming¶
Let us get an Overview of Database Programming.
When we develop web or mobile applications, data is typically stored in RDBMS Databases such as Oracle, Postgres, Mysql etc..
Even data for reporting and analytics is typically stored in Data Warehouse or MPP Databases such as Redshift, Snowflake, Teradata etc.
Here are different varieties of Databases for different purposes.
RDBMS - for example: Oracle, Mysql, Postgres, informix, MS SQL, DB2 etc.
Data Warehouse - for example: Teradata, Vertica, Greenplum, RedShift, Snowflake etc.
NoSQL - for example: MongoDB, Cassandra, HBase, DynamoDB etc.
Search based - Elasticsearch, Solr etc
Graph based - Neo4J
Almost all the databases provide JDBC driver to connect to the database from application layer.
Web or Mobile Applications are typically developed using Programming Languages like Python, Scala, Java etc.
Data Engineering is typically done by tools such as Informatica or Programming Languages such as Python.
We need to use the JDBC or ODBC driver provided to connect to the specific database where ever Databases are involved irrespective of the database that is used.
Also one should be familiar with underlying Database Concepts to be comfortable with Database programming.
Typically Databases will be setup on remote servers and accessible using the following information:
Server IP or DNS Alias on which Database Server is running.
Port Number using which Database Server is running.
Username
Password
Database Name
We typically perform CRUD Operations against our databases for Web or Mobile Applications for the transactions.
For non transactional use cases, we typically process data in batches either with in Databases or off load to ETL tools or distributed processing engines.
Note
As part of this module we will primarily focus on CRUD operations.