Today's Question:  What does your personal desk look like?        GIVE A SHOUT

 BIG DATA


  Peculiarities of cloud infrastructure

MarketsandMarkets claims that the cloud computing market is worth more than $545 bln nowadays. Moreover, by Thales, nearly 60% of worldwide commercial data is stored in the cloud today. Nay, under Exploding Topics, about 90% of large companies across the world use cloud infrastructure. So, the mentioned technology is incredibly popular among business owners worldwide presently.However, not so many company holders, as well as managers, know enough about the specified solutions. That's because modern technologies develop extremely intensively. So, entrepreneurs just can't keep up with the latest...

611 0       DATA STORAGE CLOUD INFRASTRUCTURE


  The First Bite on etcd Code

Etcd, one of the crucial components of Kubernetes. If APIServer is the heart, then etcd is the blood vessel that sends the end state of Kubernetes resources to various “organs”, providing high-speed, stable storage, and supporting APIServer’s high load performance. What if the etcd is not working properly? Just the condition as someone has a vascular disease. The deeper you know about them, the better diagnose you can make when issues occur.from unsplash, @John BarkipleRemember the local cache we finished in 20 minutes? If that is a short st...

1,207 0       SOURCE CODE ETCD


  Cloud Computing’s most Basic Concepts-Service Models

With the containerization of Docker, Kubernetes, CNCF, and the development of open-source communities, related frameworks and technology is booming and iterating rapidly. Cloud Computing, been applied for many years, is pushing developers into the new technological era. Companies and developers who are not using or not planning to use Cloud-Native gradually feel tremendous pressure in keeping up with the technology trends.The first step is to understand the concepts of IaaS, PaaS, FaaS, SaaS, Serverless, CaaS, etc., which appear in almost all cloud computing-related conferences, technologies, ...

1,276 0       CLOUD PAAS IAAS CONCEPT


  PaaS vs. SaaS: The Differences And How To Pick The Right Option

Platform as a service (PaaS) and software as a service (SaaS) are two kinds of cloud computing products that enable businesses and their clients to deliver and use various services, respectively. Before diving into the differences between the two concepts, it’s important to take a step back and understand what a cloud service really is.Cloud computing primarily refers to large storage of data, programs, and operations that are accessible via the Internet and are not stored on a user’s computer. These on-demand services are stored in the “cloud,” which is managed and mai...

1,116 0       CLOUD PAAS SAAS


  How Cloud Technologies Are Taking Over the World

Cloud technologies are some of the biggest accelerators of innovation today. The demand for increased speed and service delivery is driving the adoption and development of cloud platforms across industries.Gartner forecasts that the global public cloud service market will reach US$331.2 billion (S$455.83) in 2022, enjoying a 12.6% compounded annual growth rate. In Southeast Asia alone, it is estimated to reach US$40.32 billion (S$55.59 billion) by 2025 with a growing adoption among small and medium enterprises.Cloud computing is a service that businesses rent from providers which includes data...

1,214 0       CLOUD COMPUTING CLOUD


  Cracking the Data Lineage Code

What is Data Lineage? Data lineage describes the life-cycle of data, from its origins to how it is manipulated over time until it reaches its present form. The lineage explains the various processes involved in the data flow of an organization and the factors that influence each process. In other words, data lineage provides data about your data. Data lineage helps organizations of all sizes handle Big Data, as finding the creation point of the data and its evolution provides valuable insights.Almost every decision can be helped by data lineage, from a software engineer choosing what...

1,142 0       BUSINESS BIG DATA DATA LINEAGE


  How Kafka achieves high throughput low latency

Kafka is a message streaming system with high throughput and low latency. It is widely adopted in lots of big companies. A well configured Kafka cluster can achieve super high throughput with millions of concurrent writes. How Kafka can achieve this? This post will try to explain some technologies used by Kafka.Page cache + Disk sequential writeEvery time when Kafka receives a record, it will write it to disk file eventually. But if it writes to disk every time it receives a record, it would not have very good performance. In fact, Kafka has a fantastic design here which is it utilizes the pag...

8,343 0       KAFKA BIG DATA


  Redis Cluster and Common Partition Techniques in Distributed Cache

In this post, I will discuss a few common partition techniques in distributed cache. Especially, I will elaborate on my understanding on the use of Redis Cluster.Please understand that at the time of writing, the latest version of Redis is 4.0.10. Many articles on the same topic have a different idea from this post. This is mainly because, those articles are probably outdated. In particular, they may refer to the Redis Cluster implementation in Redis 3. Redis Cluster has been improved a lot since Redis 4.Common Partition TechniquesHere, we refer to horizontal partitioning, which...

5,414 0       REDIS DISTRIBUTED CACHE CLOUD COMPUTING