{"id":302396,"date":"2021-07-19T12:00:19","date_gmt":"2021-07-19T09:00:19","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/the-best-cloud-services-for-high-data-transfer-workloads-cloudsavvy-it\/"},"modified":"2021-07-19T12:00:19","modified_gmt":"2021-07-19T09:00:19","slug":"the-best-cloud-services-for-high-data-transfer-workloads-cloudsavvy-it","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/the-best-cloud-services-for-high-data-transfer-workloads-cloudsavvy-it\/","title":{"rendered":"#The Best Cloud Services For High Data Transfer Workloads \u2013 CloudSavvy IT"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_84 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6a2ddd7fdf382\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6a2ddd7fdf382\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/the-best-cloud-services-for-high-data-transfer-workloads-cloudsavvy-it\/#Data_Is_Expensive\" >Data Is Expensive<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/buradabiliyorum.com\/en\/the-best-cloud-services-for-high-data-transfer-workloads-cloudsavvy-it\/#How_Much_Data_Am_I_Using\" >How Much Data Am I Using?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/buradabiliyorum.com\/en\/the-best-cloud-services-for-high-data-transfer-workloads-cloudsavvy-it\/#AWS_Lightsail\" >AWS Lightsail<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/buradabiliyorum.com\/en\/the-best-cloud-services-for-high-data-transfer-workloads-cloudsavvy-it\/#Digital_Ocean\" >Digital Ocean<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/buradabiliyorum.com\/en\/the-best-cloud-services-for-high-data-transfer-workloads-cloudsavvy-it\/#Dedicated_Cloud_Servers\" >Dedicated Cloud Servers<\/a><\/li><\/ul><\/nav><\/div>\n<p><strong>&#8220;#The Best Cloud Services For High Data Transfer Workloads \u2013 CloudSavvy IT&#8221;<\/strong><\/p>\n<div id=\"article-content-area\">\n<figure style=\"width: 700px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" class=\"type:primaryImage wp-image-12768 size-full\" srcset=\"https:\/\/www.cloudsavvyit.com\/p\/uploads\/2021\/07\/dcea5e4e.png?width=398&amp;trim=1,1&amp;bg-color=000&amp;pad=1,1 400w, https:\/\/www.cloudsavvyit.com\/p\/uploads\/2021\/07\/dcea5e4e.png?width=1198&amp;trim=1,1&amp;bg-color=000&amp;pad=1,1 1200w\" sizes=\"auto, 400w, 1200w\" src=\"https:\/\/www.cloudsavvyit.com\/p\/uploads\/2021\/07\/dcea5e4e.png?width=1198&amp;trim=1,1&amp;bg-color=000&amp;pad=1,1\" alt=\"\" width=\"700\" height=\"394\" data-credittext=\"wisawa222\/Shutterstock.com\" onload=\"pagespeed.lazyLoadImages.loadIfVisibleAndMaybeBeacon(this);\" onerror=\"this.onerror=null;pagespeed.lazyLoadImages.loadIfVisibleAndMaybeBeacon(this);\"\/><figcaption class=\"wp-caption-text\"><span class=\"type:primaryImage imagecredit\">wisawa222\/Shutterstock.com<\/span><\/figcaption><\/figure>\n<p>Many cloud providers charge for data transfer, often for each GB every month. These costs can be so high that it may be prohibitively expensive to run some data-heavy services. If you still want to move to the cloud, what can you do to mitigate your bandwidth bill?<\/p>\n<h2 role=\"heading\" aria-level=\"2\"><span class=\"ez-toc-section\" id=\"Data_Is_Expensive\"><\/span>Data Is Expensive<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Most of the big name cloud providers charge for data, and it\u2019s usually unavoidable if you want to use those services. In an effort to be as efficient as possible, providers like AWS micro-optimize all of their pricing, and will charge you exorbitant rates if you want to run a data-heavy workload.<\/p>\n<p>AWS charges <strong>$0.09<\/strong> per GB of data. Azure charges\u00a0<strong>$0.0875<\/strong> per GB. Google Cloud Platform charges\u00a0<strong>$0.08<\/strong>. All data coming in is free, and all data being transferred between local servers in the same zone is <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/general\/\" data-internallinksmanager029f6b8e52c=\"3\" title=\"General\" target=\"_blank\" rel=\"noopener\">general<\/a>ly free, but once it leaves and goes out to the internet, you have to pay for it. This can be a problem if you are sending terabytes every month.<\/p>\n<p>The big three\u2014AWS, Azure, and GCP\u2014all have offerings for dedicated servers, but none of them come with dedicated bandwidth. They may have dedicated Mbps connections, but all that does it let you spend your money faster.<\/p>\n<p>Unfortunately, the solution is usually to either attempt to limit your data as much as possible, like with gzip compression, or to give up on using a big name provider, and use a smaller provider that bundles compute with bandwidth at a reasonable price.<\/p>\n<p>This may mean that you won\u2019t be able to use many of the services that come with state-of-the-art cloud providers like AWS, but if you don\u2019t have the money to pay their fees, that may not even be an option in the first place.<\/p>\n<h2 role=\"heading\" aria-level=\"2\"><span class=\"ez-toc-section\" id=\"How_Much_Data_Am_I_Using\"><\/span>How Much Data Am I Using?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>If you don\u2019t know how much data you\u2019re currently using, you\u2019ll want to monitor that to get an idea of what services you should use.<\/p>\n<p>There\u2019s a lot of Linux utilities for measuring this, but <code>vnstat<\/code>\u00a0is lightweight and works well.<\/p>\n<pre>sudo apt install vnstat<\/pre>\n<p>This will display totals on the command line, and can also generate PNGs displaying data usage.<\/p>\n<p><img decoding=\"async\" src=\"https:\/\/www.cloudsavvyit.com\/p\/uploads\/2020\/06\/96a1eddb.png?trim=1,1&amp;bg-color=000&amp;pad=1,1\" alt=\"An image summary\" onload=\"pagespeed.lazyLoadImages.loadIfVisibleAndMaybeBeacon(this);\" onerror=\"this.onerror=null;pagespeed.lazyLoadImages.loadIfVisibleAndMaybeBeacon(this);\"\/><\/p>\n<p>If you\u2019re on AWS, you can view EC2 usage and usage for other services in the CloudWatch Dashboard.<\/p>\n<p><strong>RELATED:<\/strong> <strong><em>How to View How Much Bandwidth Your AWS EC2 Instances Are Using<\/em><\/strong><\/p>\n<h2 role=\"heading\" aria-level=\"2\"><span class=\"ez-toc-section\" id=\"AWS_Lightsail\"><\/span>AWS Lightsail<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>AWS is notorious for their awful data pricing, but in an attempt to compete with providers like Digital Ocean (which is simpler and charges bargain rates for data), they launched AWS Lightsail, which is the only saving grace for the big name cloud providers.<\/p>\n<p>Lightsail is a simpler version of AWS that only offers a few services. However, it still offers compute instances and managed databases, and you can still interface with regular AWS services. It\u2019s essentially EC2, but simpler with an interface designed for beginners.<\/p>\n<p>Here\u2019s the best part\u2014each instance comes with multiple terabytes of data transfer per month, more than Digital Ocean even offers at some tiers. You\u2019ll still pay overage fees, but you can always upgrade or purchase additional instances.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\" alignnone wp-image-2314 size-full\" src=\"https:\/\/www.cloudsavvyit.com\/p\/uploads\/2019\/10\/f278c48d.png?trim=1,1&amp;bg-color=000&amp;pad=1,1\" alt=\"Choose your instance plan.\" width=\"700\" height=\"306\" onload=\"pagespeed.lazyLoadImages.loadIfVisibleAndMaybeBeacon(this);\" onerror=\"this.onerror=null;pagespeed.lazyLoadImages.loadIfVisibleAndMaybeBeacon(this);\"\/><\/p>\n<p>Great right? Well, there are a few catches. Since it can talk to other AWS resources, AWS doesn\u2019t want you abusing the service to save money, and includes the following clause in their TOS:<\/p>\n<blockquote><p>51.3. You may not use Amazon Lightsail in a manner intended to avoid incurring data fees from other Services (e.g., proxying network traffic from Services to the public internet or other destinations or excessive data processing through load balancing or content delivery network (CDN) Services as described in the Documentation), and if you do, we may throttle or suspend your data services or suspend your account.<\/p>\n<\/blockquote>\n<p>This is pretty vague, so it\u2019s not quite clear what high-data workloads Lightsail can and can\u2019t be used for.<\/p>\n<p>For most services only using Lightsail, you\u2019re probably fine. The term \u201cother Services\u201d <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/download-scripts-themes-apps\/\" data-internallinksmanager029f6b8e52c=\"9\" title=\"Download Scripts &amp; Themes &amp; Apps\" target=\"_blank\" rel=\"noopener\">app<\/a>lies to the rest of AWS outside of Lightsail. If you want to run a Lightsail database, Lightsail API service, and Lightsail web server, and they happen to be using a ton of data, you can still do so.<\/p>\n<p>However, if you\u2019re thinking of setting up a reverse proxy to directly proxy traffic from EC2, Lambda, S3, or some other service, you\u2019ll need to think of another solution. That would be a flagrant violation of their TOS, and would probably get your account throttled or shut down.<\/p>\n<p>It\u2019s a gray area whether or not you\u2019re allowed to use a Lightsail instance to run data processing on external data stores like S3 or RDS. For example, if you had a Lightsail instance that compressed images in S3 on request, you\u2019d be saving the data costs compared to using EC2. You\u2019re not disallowed from using external AWS services, but if you\u2019re using them from Lightsail with the intent to save money, you could be in violation if your usage is deemed excessive.<\/p>\n<p>It\u2019s also a bit of a gray area whether running extreme load balanced workloads entirely in Lightsail is allowed. Lightsail includes load balancers at $20 a month, but it\u2019s possible to run ten $5 instances, which each come with 2 TB of data, and pay $70 overall for 20 TB of data, which would cost nearly $2000 if you ran on EC2.<\/p>\n<p>Is using Lightsail like this cheating? Maybe not, but AWS may decide so, so proceed with caution if you want to run a data-heavy application. At the end of the day, AWS will likely decide on a case-by-case basis.<\/p>\n<p><strong>RELATED:<\/strong> <strong><em>Amazon Lightsail Is AWS for Regular People<\/em><\/strong><\/p>\n<h2 role=\"heading\" aria-level=\"2\"><span class=\"ez-toc-section\" id=\"Digital_Ocean\"><\/span>Digital Ocean<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Digital Ocean has basically molded their entire business model around being the opposite of AWS\u2014easy to use, with simple fixed pricing for all their services. While they don\u2019t have every PaaS offering that AWS and other providers may have (they don\u2019t have a competitor to Lambda, for example), they have the basics, and they\u2019re good at getting the basics right.<\/p>\n<p>Their simple burstable instances, which are comparable to AWS Lightsail and EC2 T3, provide a ton of data every month with very little restriction. Their cheaper instances, below $20, don\u2019t give as much data as Lightsail, and the SSD is smaller, but overall they\u2019re very comparable.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-12762\" src=\"https:\/\/www.cloudsavvyit.com\/p\/uploads\/2021\/07\/da8785ed.png?trim=1,1&amp;bg-color=000&amp;pad=1,1\" alt=\"\" width=\"700\" height=\"265\" onload=\"pagespeed.lazyLoadImages.loadIfVisibleAndMaybeBeacon(this);\" onerror=\"this.onerror=null;pagespeed.lazyLoadImages.loadIfVisibleAndMaybeBeacon(this);\"\/><\/p>\n<p>What\u2019s even better is that they don\u2019t charge excessive data fees for overage data, only\u00a0$0.01 per GB, eight times cheaper than AWS. Compared to EC2, you\u2019d be saving hundreds per month<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-12763\" src=\"https:\/\/www.cloudsavvyit.com\/p\/uploads\/2021\/07\/7ec2869c.png?trim=1,1&amp;bg-color=000&amp;pad=1,1\" alt=\"\" width=\"700\" height=\"456\" onload=\"pagespeed.lazyLoadImages.loadIfVisibleAndMaybeBeacon(this);\" onerror=\"this.onerror=null;pagespeed.lazyLoadImages.loadIfVisibleAndMaybeBeacon(this);\"\/><\/p>\n<p>They\u2019re also easy to create and destroy, so if you want to run these in an autoscaling group, you\u2019re free to do so. However, Digital Ocean doesn\u2019t have built in auto-scaling support yet <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/docs.digitalocean.com\/products\/kubernetes\/how-to\/autoscale\/\">unless you\u2019re using Kubernetes<\/a>, so you\u2019ll need to automate that yourself.<\/p>\n<p>It\u2019s certainly cheap, and will probably work for many businesses, but its lack of many services can be a turn off. If you want premium AWS services like Lambda, you\u2019ll need to pay premium prices.<\/p>\n<p>You <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.digitalocean.com\/products\/\">can check their products page<\/a> for an up to date list, but they offer:<\/p>\n<ul>\n<li>VPS Compute with \u201cDroplets\u201d<\/li>\n<li>Kubernetes, using Droplets<\/li>\n<li>Managed DB using Droplets<\/li>\n<li>An \u201cApp Platform\u201d service like <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/aws.amazon.com\/apprunner\/pricing\/?tag=reviewgeek-20\">AWS App Runner<\/a><\/li>\n<li>S3 compatible object store, with 250 GB free plus $0.02 per GB stored after that, and 1 TB of transfer plus\u00a0<span data-price=\"outbound-transfer\">$0.01<\/span>\u00a0per additional GB<\/li>\n<li>Local volumes, like AWS EBS.<\/li>\n<\/ul>\n<p>And, unfortunately, not much else at this point besides basic networking and monitoring tools.<\/p>\n<h2 role=\"heading\" aria-level=\"2\"><span class=\"ez-toc-section\" id=\"Dedicated_Cloud_Servers\"><\/span>Dedicated Cloud Servers<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Some cloud providers, like those offering dedicated servers, don\u2019t charge for data per GB, and instead give you a dedicated and unmetered connection at a fixed Mbps.<\/p>\n<p>For example, OVH is a provider focused mostly on dedicated machines, and simply provides unmetered bandwidth for most of their instances.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-12764\" src=\"https:\/\/www.cloudsavvyit.com\/p\/uploads\/2021\/07\/0826e6a2.png?trim=1,1&amp;bg-color=000&amp;pad=1,1\" alt=\"\" width=\"700\" height=\"327\" onload=\"pagespeed.lazyLoadImages.loadIfVisibleAndMaybeBeacon(this);\" onerror=\"this.onerror=null;pagespeed.lazyLoadImages.loadIfVisibleAndMaybeBeacon(this);\"\/><\/p>\n<p>This may vary based on region though, as data transferred out from machines in places like Australia will be metered unless you pay a lot extra per month. However, this is still 5 TB of traffic, so it\u2019s probably fine for most people.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-12765\" src=\"https:\/\/www.cloudsavvyit.com\/p\/uploads\/2021\/07\/9d3bcbbe.png?trim=1,1&amp;bg-color=000&amp;pad=1,1\" alt=\"\" width=\"631\" height=\"224\" onload=\"pagespeed.lazyLoadImages.loadIfVisibleAndMaybeBeacon(this);\" onerror=\"this.onerror=null;pagespeed.lazyLoadImages.loadIfVisibleAndMaybeBeacon(this);\"\/><\/p>\n<p><a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.linode.com\/pricing\/\">Linode<\/a> is another provider that offers both shared virtual servers and dedicated machines. Their pricing is comparable to Lightsail and Digital Ocean, and offers a few TB of transfer per month as well as multiple Gbps of egress speed.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-12766\" src=\"https:\/\/www.cloudsavvyit.com\/p\/uploads\/2021\/07\/f3e70003.png?trim=1,1&amp;bg-color=000&amp;pad=1,1\" alt=\"\" width=\"700\" height=\"346\" onload=\"pagespeed.lazyLoadImages.loadIfVisibleAndMaybeBeacon(this);\" onerror=\"this.onerror=null;pagespeed.lazyLoadImages.loadIfVisibleAndMaybeBeacon(this);\"\/>\n<\/div>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMLG0nwswvr63Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\">For forums sites go to <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/forum.buradabiliyorum.com\/\" target=\"_blank\" rel=\"noopener\">Forum.BuradaBiliyorum.Com<\/a><\/span><\/strong>\n<\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more like this article, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/technology\/\" target=\"_blank\" rel=\"noopener\">Technology category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/www.cloudsavvyit.com\/12756\/the-best-cloud-services-for-high-data-transfer-workloads\/\" target=\"_blank\" rel=\"noopener\">Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;#The Best Cloud Services For High Data Transfer Workloads \u2013 CloudSavvy IT&#8221; wisawa222\/Shutterstock.com Many cloud providers charge for data transfer, often for each GB every month. These costs can be so high that it may be prohibitively expensive to run some data-heavy services. If you still want to move to the cloud, what can you&#8230;<\/p>\n","protected":false},"author":1,"featured_media":302397,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/www.cloudsavvyit.com\/p\/uploads\/2021\/07\/dcea5e4e.png","fifu_image_alt":"","footnotes":""},"categories":[18],"tags":[],"class_list":["post-302396","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/302396","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=302396"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/302396\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/302397"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=302396"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=302396"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=302396"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}