Taking the first steps into the tech field can be overwhelming, as it is vast and intense. There are numerous career opportunities available, but discovering them can take time. Even if you do discover them, understanding the requirements and functions of each role can be challenging and nerve-wracking

I was in the same position last year. As I stepped into my first year of college, I found myself without an external guide. I completed my first year without a clear idea of what I wanted to pursue after engineering. I went through many guides, but they weren’t very helpful. They were filled with technical terms, and I spent most of my time just googling these terms.

In my second year, I consolidated everything I learned in my first year, gained a clearer understanding, and continued to explore. However, many people I know still don’t have a clear understanding of the career opportunities available.

That’s what motivated me to start this series. Here, I’ll explore the various options available and explain them in a clear and concise manner to avoid overwhelming you. Stick with me throughout this journey, and I assure you it’ll be extremely fruitful.

Day 1 : Data Engineering

I’m sure you’ve heard of data scientists and data analysts. They are exciting careers in recent times. But did you know there’s another exciting career called data engineering?

According to the Dice Tech Job Report, 2020, Data Engineering is one of the fastest-growing tech occupations.

So, what do data engineers do? What are the requirements to become a data engineer? Read on to find out.

Data engineers work on making data available for data scientists and analysts. If you’re familiar with Data Science or Data Analytics, you must’ve heard of NumPy, Pandas, Matplotlib, etc. These are Python libraries used to work on data. Whether it’s Arrays (NumPy) or Data Frames (Pandas), you essentially need data from which you can draw insights using various tools. But the big question is - from where do we get the data? Even if we get the data, we need to ensure it is clean and complete, and that data scientists and analysts can easily access it. This is where a data engineer comes into picture.

Going with the textbook definition of Data Engineering,

Data engineering is the discipline which creates data collection, storage, transformation, and analysis processes for large amounts of raw data, structured data, semi-structured data, and unstructured data (e.g., Big Data) so that data science professionals can draw valuable insights from it.

Source(mongodb.com)

There are three types of Data Engineers.

1. Generalists : These data engineers work end-to-end in small teams. They usually have more skills but less knowledge of system architecture. If you’re a data scientist who wants to make a career shift , then this role is for you.

2. Pipeline-centric engineers : These engineers focus on the movement , transition of data across systems. Their role involves building pipelines - systems that transfer data from various sources to various destinations often performing some transformations along the way.

3. Database-centric engineers : They focus on the design , implementation and management of databases that store and organize data for applications. They create table schemas using ETL methods.

ETL? What is that?

ETL stands for Extract , Transform and Load. It is used to gather data from different sources , transform it into a usable format and load it into a final storage system.

Typical responsibilities of a data engineer:

• Build, test and maintain database pipeline architectures.

• Create methods for data validation.

• Acquire data.

• Clean data.

• Develop data set processes.

• Improve data reliability and quality.

• Develop algorithms to make data usable.

• Prepare data for prescriptive and predictive modeling.

Glossary:

Prescriptive modeling - It is a a type of data analytics which sheds light on what actions to take in order to achieve a desirable outcome.

Predictive modeling - It forecasts future trends based on historical data.

Now that you’re familiar with the roles and responsibilities of a data engineer , let’s take a look at the skillset required for that position:

1. Proficiency in programming languages such as C#, Java, Python, R, Ruby, Scala and SQL.

2. Good understanding of data warehouses and data lakes.

3. Basic understanding of ML Algorithms.

4. Skilled in NoSQL databases and Apache Spark systems.

5. Good knowledge of Unix based operating systems.

Glossary:

Data Warehouse - A data warehouse is a centralized repository designed to store large volumes of structured data.

Data Lake - A data lake is a large, scalable storage repository that can hold vast amounts of raw, unstructured, semi-structured, and structured data

Apache Spark - It is an open-source, distributed computing framework primarily used for processing large datasets. It offers high-performance capabilities for both batch and real-time data processing.

As we wrap up this article, I hope it has sparked your interest in the dynamic field of data engineering. If you're curious to learn more, I highly recommend exploring this career path further. A great starting point is the free data engineering course available on Google Cloud Skills Boost. Dive in and discover the exciting opportunities that await you. I’d love to hear your thoughts and feedback on this article, so feel free to share your views in the comments below!

In this article, I’ll guide you on building your first website. At the end of this article , you’ll be able to brag to your friends that you built your own website.

As tech-savvy as it sounds, it's actually quite simple.

All you need to get started:

1. VS Code ( or any code editor works)

2. A laptop

Set up your laptop / desktop , grab a cup of coffee and you're all set!

Now open your preferred code editor.

Go to File → Open Folder → Select a folder where you want to store your file. Choose an already existing folder or create a new folder.

Once you open the folder in your editor , create a file called index.html.

In that file copy paste the following code.

<!DOCTYPE html>
<html>
<head>
    <title>Hello World Example</title>
</head>
<body>
    <h1>Hello, World!</h1>
</body>
</html>

The above html code displays a “Hello , World!” message on the browser.

Now copy paste the path of the file by right clicking on the file name. Open a preferred browser of your choice and paste the copied location in the search bar.

You will see an output like this on your browser. Cool right?

Now , isn’t the black color of the text too bland? How about we change the color and reduce the font size of the word? Let’s try it too!

In your working directory , create another file called styles.css.

Copy paste the below code in the newly created file.

h1 {
    color: blue;
    font-size: 20px;
}

Now that we have changed the code we’ll have to reload the website.

You can do this in two ways:

1. Open a new tab and paste the location of the file.

2. This method is even more simpler.

   

   Just click this icon to reload your browser.

Now your output will look like the above image.

There you go , you have your first website!

You can play around with different colors , font sizes to make the content visually appealing.

You've taken the initial steps into the world of web development, and now you have a basic understanding of how to create and style a webpage. Remember, this is just the beginning. There are countless possibilities to explore, from adding interactive elements with JavaScript to creating complex layouts with CSS frameworks. Keep experimenting, learning, and building, and soon you'll be able to create more sophisticated and dynamic websites. Happy coding!

I'm back today with an exciting article on databases.

What is a database?

A database is an organized collection of data that is stored and managed to make it easy to access, retrieve, and update. Databases allow users to store large amounts of information efficiently and securely. They are used in various applications to store data like user information, financial transactions, product inventories, and more.

Databases are the backbone of many applications currently existing in markets.

There are different types of databases:

1. Relational Databases - Data is stored in table and relationships between tables are managed using keys.

   Eg: MySQL , Oracl SqlPlus , PostgreSQL

2. No-SQL databases - Data is stored in a non tabular format. This type of data storage is flexible and scalable

   Eg: MongoDb

3. In-memory databases - Data is stored and manipulated directly in the computer’s RAM.

   Eg: Redis

4. Cloud databases - Databases are hosted on various cloud platforms offering ease of access without the need to manage physical infrastructure.

   Eg: Firestore

5. Distributed databases - Databases are spread across multiple locations or servers but act as a single system to the user.

   Eg: Apache Cassandra

Depending on the type of application you want to develop, you should choose a database type that suits your needs. For instance, Facebook uses a relational database to store user relationships, while Twitter relies on NoSQL databases to handle the latest tweets.

The necessity of a database is clear; without data, nothing can exist in this world. From logging onto a site to viewing personalized recommendations, data drives everything. This is why companies have specialized personnel dedicated to managing databases.

Developing an effective database structure tailored to your application is crucial. The database should be highly scalable and robust, ensuring it doesn't fail at any stage, as this could lead to significant losses for the company. A real-life scenario illustrates the importance of having a proper database structure.

Remember the Coldplay concert booking? The entire nation was in a frenzy trying to secure tickets. I heard people mentioning they were positioned at the 500,000 mark in the queue, and frankly, I didn’t understand the craze because I had never heard of the band.

On September 22nd, when traffic to Book My Show surged, the entire site crashed.

(Note: "Traffic" here refers to the large number of users accessing a site simultaneously.)

I recently attended a seminar conducted by seniors at my college. One of the speakers emphasized on this real life situation when she was talking about web development. If you're unsure what this term means, check out my article on “How to Get Started with Web Development.”

The technical team at Book My Show did not anticipate the enormous demand for ticket bookings, which led to the failure of their database structure under such high loads. Although they rectified the issue afterward, the crash resulted in significant customer dissatisfaction. In today's fast-paced digital environment, every millisecond counts. As programmers, it is our responsibility to ensure that companies do not face backlash from customers due to technological failures.

In conclusion, databases are an essential component of modern applications, providing the foundation for storing, managing, and retrieving data efficiently. With various types of databases available, such as relational, NoSQL, in-memory, cloud, and distributed databases, developers can choose the most suitable option based on their application's needs. The importance of a well-structured and scalable database cannot be overstated, as it directly impacts the performance and reliability of applications, especially during high traffic events. As technology continues to evolve, the role of databases will remain crucial in ensuring seamless user experiences and supporting the growing demands of data-driven applications.

In this article, I’ll guide you on how to kickstart your journey in web development and gradually scale up to become a full stack web developer. Whether you’re aiming for an internship in your third year or just curious about the field, this guide is here to help.

What is Web Development?

Web development is the art of creating websites. It encompasses everything from the vibrant animations you see on webpages to the seamless booking experiences on e-commerce platforms like Amazon. Simply put, web development involves building, maintaining, and improving websites and web applications.

How to Get Started with Web Development

What are the languages and frameworks you should learn to land a full stack developer internship? Don’t worry; I’m here to guide you through it!

Web development is broadly divided into two main areas:

1. Frontend Development

Remember the colorful animations and engaging visuals on websites? Or when you click the submit button on a form, and a pop-up confirms that the form owner will get in touch with you? All of these fall under the umbrella of frontend development.

Frontend Development focuses on client-side interactions, offering users a seamless and engaging experience. It’s all about making the website visually appealing and intuitive to use. For example, who doesn’t enjoy interacting with a site where images slide smoothly, drawing attention, telling a story, and adding a touch of liveliness to the browsing experience? That’s the power of frontend development — it attracts and engages users.

2. Backend Development

On the other hand, Backend Development is the less visible, yet crucial, part of the web development process. It’s where all the data and core functionalities are handled. Imagine you signed up on a website, forgot about it for a few days, and then decided to log back in. When you enter your credentials, they are verified, and you successfully log in. This process is a small glimpse of what backend development handles.

Who is a Full Stack Developer?

A full stack developer is someone who can develop both the frontend and backend of a web application. They have the skills to build an entire web solution, from designing the layout of the website to managing the server-side logic and database interactions. Essentially, they’re a one-stop solution for web development.

How to Start Building Websites: Essential Tech Stack

Wondering how to begin your journey as a web developer? Here are the technologies you should start with:

Frontend:

HTML: The backbone of any website, used to structure content.

CSS: For styling and adding visual appeal.

JavaScript: To make your website interactive and dynamic.

Backend:

Node.js: A powerful, popular choice for server-side programming.

Flask: A lightweight Python framework that’s great for beginners.

Database:

MySQL: A relational database for structured data.

MongoDB: A NoSQL database for more flexible data storage.

These are just a few of the options available. Once you get comfortable building simple websites, feel free to explore and experiment with different tech stacks to find what suits you best.

Getting started with web development can be both exciting and rewarding. Once you grasp the basics, you’ll have endless possibilities to create and innovate. So, dive in, experiment, and most importantly — enjoy the learning process!

Stay tuned for more articles, and happy coding!