• Log InLog In
  • Register
Liquid`
Team Liquid Liquipedia
EDT 03:18
CEST 09:18
KST 16:18
  • Home
  • Forum
  • Calendar
  • Streams
  • Liquipedia
  • Features
  • Store
  • EPT
  • TL+
  • StarCraft 2
  • Brood War
  • Smash
  • Heroes
  • Counter-Strike
  • Overwatch
  • Liquibet
  • Fantasy StarCraft
  • TLPD
  • StarCraft 2
  • Brood War
  • Blogs
Forum Sidebar
Events/Features
News
Featured News
RSL Season 1 - Final Week6[ASL19] Finals Recap: Standing Tall12HomeStory Cup 27 - Info & Preview18Classic wins Code S Season 2 (2025)16Code S RO4 & Finals Preview: herO, Rogue, Classic, GuMiho0
Community News
Esports World Cup 2025 - Brackets Revealed11Weekly Cups (July 7-13): Classic continues to roll4Team TLMC #5 - Submission extension3Firefly given lifetime ban by ESIC following match-fixing investigation17$25,000 Streamerzone StarCraft Pro Series announced7
StarCraft 2
General
Esports World Cup 2025 - Brackets Revealed Who will win EWC 2025? RSL Revival patreon money discussion thread The GOAT ranking of GOAT rankings Weekly Cups (July 7-13): Classic continues to roll
Tourneys
FEL Cracov 2025 (July 27) - $8000 live event RSL: Revival, a new crowdfunded tournament series $5,100+ SEL Season 2 Championship (SC: Evo) WardiTV Mondays Sparkling Tuna Cup - Weekly Open Tournament
Strategy
How did i lose this ZvP, whats the proper response Simple Questions Simple Answers
Custom Maps
External Content
Mutation # 482 Wheel of Misfortune Mutation # 481 Fear and Lava Mutation # 480 Moths to the Flame Mutation # 479 Worn Out Welcome
Brood War
General
BW General Discussion Flash Announces (and Retracts) Hiatus From ASL BGH Auto Balance -> http://bghmmr.eu/ Starcraft in widescreen A cwal.gg Extension - Easily keep track of anyone
Tourneys
[Megathread] Daily Proleagues Cosmonarchy Pro Showmatches CSL Xiamen International Invitational [BSL20] Non-Korean Championship 4x BSL + 4x China
Strategy
Simple Questions, Simple Answers I am doing this better than progamers do.
Other Games
General Games
Stormgate/Frost Giant Megathread Nintendo Switch Thread Path of Exile CCLP - Command & Conquer League Project The PlayStation 5
Dota 2
Official 'what is Dota anymore' discussion
League of Legends
Heroes of the Storm
Simple Questions, Simple Answers Heroes of the Storm 2.0
Hearthstone
Heroes of StarCraft mini-set
TL Mafia
TL Mafia Community Thread Vanilla Mini Mafia
Community
General
US Politics Mega-thread Russo-Ukrainian War Thread Stop Killing Games - European Citizens Initiative Summer Games Done Quick 2025! Things Aren’t Peaceful in Palestine
Fan Clubs
SKT1 Classic Fan Club! Maru Fan Club
Media & Entertainment
[Manga] One Piece Movie Discussion! Anime Discussion Thread [\m/] Heavy Metal Thread
Sports
Formula 1 Discussion TeamLiquid Health and Fitness Initiative For 2023 2024 - 2025 Football Thread NBA General Discussion NHL Playoffs 2024
World Cup 2022
Tech Support
Computer Build, Upgrade & Buying Resource Thread
TL Community
The Automated Ban List
Blogs
Men Take Risks, Women Win Ga…
TrAiDoS
momentary artworks from des…
tankgirl
from making sc maps to makin…
Husyelt
StarCraft improvement
iopq
Trip to the Zoo
micronesia
Customize Sidebar...

Website Feedback

Closed Threads



Active: 653 users

The Big Programming Thread - Page 757

Forum Index > General Forum
Post a Reply
Prev 1 755 756 757 758 759 1031 Next
Thread Rules
1. This is not a "do my homework for me" thread. If you have specific questions, ask, but don't post an assignment or homework problem and expect an exact solution.
2. No recruiting for your cockamamie projects (you won't replace facebook with 3 dudes you found on the internet and $20)
3. If you can't articulate why a language is bad, don't start slinging shit about it. Just remember that nothing is worse than making CSS IE6 compatible.
4. Use [code] tags to format code blocks.
Hhanh00
Profile Joined May 2016
34 Posts
August 26 2016 14:59 GMT
#15121
https://www.quora.com/What-are-the-biggest-websites-built-with-Node-js-on-the-server-side


- Walmart (Why Walmart is using Node.js )
- E-bay / PayPal ( Node.js at PayPal)
- Microsoft (Node.js Dev Center | Windows Azure) They have extensive support, in fact their Azure CLI tools are actually written in Node.js.
- LinkedIn (Exclusive: How LinkedIn used Node.js and HTML5 to build a better, faster app)
- Yahoo
- Google (Node at scale: What Google, Mozilla, & Yahoo are doing with Node.js)
- Yammer (now part of Microsoft) (Managing Node.js Dependencies and Deployments at Yammer - Yammer Engineering)
- Netflix has a series of blog posts on its use (Search results for node.js)(Updated 2016-02)
- Looks like Uber is using it as well (Updated 2016-03)

phar
Profile Joined August 2011
United States1080 Posts
August 26 2016 16:01 GMT
#15122
Just to point out, many of your links do not actually describe large scale websites built with node (e.g. the Google sub article).
Who after all is today speaking about the destruction of the Armenians?
tofucake
Profile Blog Joined October 2009
Hyrule19035 Posts
August 26 2016 17:05 GMT
#15123
On August 26 2016 23:59 Hhanh00 wrote:
https://www.quora.com/What-are-the-biggest-websites-built-with-Node-js-on-the-server-side

Show nested quote +

- Walmart (Why Walmart is using Node.js )
- E-bay / PayPal ( Node.js at PayPal)
- Microsoft (Node.js Dev Center | Windows Azure) They have extensive support, in fact their Azure CLI tools are actually written in Node.js.
- LinkedIn (Exclusive: How LinkedIn used Node.js and HTML5 to build a better, faster app)
- Yahoo
- Google (Node at scale: What Google, Mozilla, & Yahoo are doing with Node.js)
- Yammer (now part of Microsoft) (Managing Node.js Dependencies and Deployments at Yammer - Yammer Engineering)
- Netflix has a series of blog posts on its use (Search results for node.js)(Updated 2016-02)
- Looks like Uber is using it as well (Updated 2016-03)


Yeah, plenty of companies use Node for some things, but most of them are driven by PHP (likely C# in Microsoft's case), C, and Go. None of those sites are majority node. Like the Azure CLI: only the tools are written in Node.
Liquipediaasante sana squash banana
phar
Profile Joined August 2011
United States1080 Posts
August 26 2016 19:10 GMT
#15124
And Java

So much Java

:/


Though also worth pointing out that most places don't need the same kind of scale as ms Google whatever.
Who after all is today speaking about the destruction of the Armenians?
TheEmulator
Profile Blog Joined July 2010
28087 Posts
August 26 2016 20:31 GMT
#15125
On August 26 2016 21:37 tofucake wrote:
Show nested quote +
On August 26 2016 14:31 Wrath wrote:
On August 26 2016 06:28 BisuDagger wrote:
On August 26 2016 06:20 Wrath wrote:
On August 26 2016 05:39 tofucake wrote:
it's single threaded, which is a huge issue


Why?

Google is a great resource for these types of questions. I know little about node and now im that much more informed after google research!

http://stackoverflow.com/questions/17959663/why-is-node-js-single-threaded


My question was why it is a huge issue not why it is a single threaded

If you're looking to do some standard website, node is a crap choice. Something like TL would go down in flames if it were made in node, nevermind any big site. Nobody will create the next Facebook/Google/Etsy/Ebay/PayPal/Expedia/Whatever until node gets multithreading.

Unfortunately TL's backend is based on your least favorite language (unless it was someone else that hated PHP).
Administrator
phar
Profile Joined August 2011
United States1080 Posts
Last Edited: 2016-08-26 21:51:20
August 26 2016 21:48 GMT
#15126
Yea but TL is a tiny website that is very unlikely to need to scale beyond the capabilities of PHP. And that's fine. Most websites don't need scale beyond what MySQL PHP perl node whatever can handle.

Right like I just did an interview today where the candidate and I settled on an approximate db size of 100 billion entries, and it was actually ok to do with fairly simple tech. There's nothing wrong with that.
Who after all is today speaking about the destruction of the Armenians?
phar
Profile Joined August 2011
United States1080 Posts
August 26 2016 21:56 GMT
#15127
In fact I would say more common is that something does get built in poorly scaling tech, then gets big. And then people scramble to scale (either by hacking on the tech, porting, or what have you).

Designing from the outset wih the expectation of having hundreds of millions of users and petabytes of data to crunch is the exception, not the rule.
Who after all is today speaking about the destruction of the Armenians?
Hhanh00
Profile Joined May 2016
34 Posts
August 27 2016 01:00 GMT
#15128
TL would go in flames if based on node.js, but it's ok for Linked in to use node.js for their mobile backend.

If you're looking to do some standard website, node is a crap choice. Something like TL would go down in flames if it were made in node, nevermind any big site.


“On the server side, our entire mobile software stack is completely built in Node,” said Prasad. “We use a ton of technologies at LinkedIn, but for the mobile server piece, it’s entirely Node-based.

Wrath
Profile Blog Joined July 2014
3174 Posts
August 27 2016 05:47 GMT
#15129
Yea but TL is a tiny website that is very unlikely to need to scale beyond the capabilities of PHP. And that's fine. Most websites don't need scale beyond what MySQL PHP perl node whatever can handle.


What do you mean "Scale beyond the capabilities of PHP"? Facebook is built on PHP, isn't that strong enough?
Nesserev
Profile Blog Joined January 2011
Belgium2760 Posts
Last Edited: 2016-08-27 08:01:42
August 27 2016 07:57 GMT
#15130
--- Nuked ---
phar
Profile Joined August 2011
United States1080 Posts
August 27 2016 08:04 GMT
#15131
Also Facebook PHP is quite different. See hiphop for example.
Who after all is today speaking about the destruction of the Armenians?
Wrath
Profile Blog Joined July 2014
3174 Posts
Last Edited: 2016-08-27 09:24:57
August 27 2016 09:24 GMT
#15132
OK, if PHP is too limited for huge websites, what tools should they use?

Also, could you please give example on how PHP is limited?
Hhanh00
Profile Joined May 2016
34 Posts
August 27 2016 10:59 GMT
#15133
NodeJS isn't very fast by itself but big companies can offset its low performance by throwing hardware and money at it. For PHP, since it's a language, the result depends on the implementation and the web server that hosts the application.

Here are some raw benchmark numbers for the interested:
https://www.techempower.com/benchmarks/#section=data-r11&hw=peak&test=plaintext

NodeJS low performance can be explained by libuv using a single threaded event loop over I/O abstractions that don't match the underlying systems well resulting in needless memory allocations and context switches. Faster frameworks use native system calls like epoll/kqueue/iocp and/or aio. Some frameworks end up delivering data from disk faster than nodeJS can deliver from memory.
tofucake
Profile Blog Joined October 2009
Hyrule19035 Posts
August 27 2016 13:47 GMT
#15134
On August 27 2016 05:31 TheEmulator wrote:
Show nested quote +
On August 26 2016 21:37 tofucake wrote:
On August 26 2016 14:31 Wrath wrote:
On August 26 2016 06:28 BisuDagger wrote:
On August 26 2016 06:20 Wrath wrote:
On August 26 2016 05:39 tofucake wrote:
it's single threaded, which is a huge issue


Why?

Google is a great resource for these types of questions. I know little about node and now im that much more informed after google research!

http://stackoverflow.com/questions/17959663/why-is-node-js-single-threaded


My question was why it is a huge issue not why it is a single threaded

If you're looking to do some standard website, node is a crap choice. Something like TL would go down in flames if it were made in node, nevermind any big site. Nobody will create the next Facebook/Google/Etsy/Ebay/PayPal/Expedia/Whatever until node gets multithreading.

Unfortunately TL's backend is based on your least favorite language (unless it was someone else that hated PHP).

I actually like PHP, especially 7
Liquipediaasante sana squash banana
Manit0u
Profile Blog Joined August 2004
Poland17249 Posts
August 29 2016 07:12 GMT
#15135
On August 27 2016 18:24 Wrath wrote:
OK, if PHP is too limited for huge websites, what tools should they use?

Also, could you please give example on how PHP is limited?


When it comes to real giants I guess that everything is limited in the end. We're talking about websites that expose thousands of APIs, have user base in the millions etc. When it comes to such monsters it's highly unlikely they'll be limited to a single technology stack.

For example, with data they're most likely using CouchDB for documents, Neo4j for graph data, Redis or BerkeleyDB as primary cache and MySQL/PGSQL/Oracle/whatever as their big data store, with only maybe 10% queries actually hitting it. Then you'll have multiple backends for various parts (Facebook has PHP running on HHVM, some Scala, Node and probably other things thrown into the mix). Then you have front-end tech like Angular or React added as another layer on top of that. To further leverage this complex architecture you have some form of ESB sprinkled into the mix. Then you start to think how it's spread over a gazillion servers with reverse proxies, DB replication etc. and you realize that it's one huge clusterfuck of a mess.

Nowadays you don't limit yourself to a single tech. You pick the tool that best suits your needs for specific parts and then build everything as SOA so you can pretend it's one huge app.
Time is precious. Waste it wisely.
Wrath
Profile Blog Joined July 2014
3174 Posts
August 29 2016 07:18 GMT
#15136
On August 29 2016 16:12 Manit0u wrote:
Show nested quote +
On August 27 2016 18:24 Wrath wrote:
OK, if PHP is too limited for huge websites, what tools should they use?

Also, could you please give example on how PHP is limited?


When it comes to real giants I guess that everything is limited in the end. We're talking about websites that expose thousands of APIs, have user base in the millions etc. When it comes to such monsters it's highly unlikely they'll be limited to a single technology stack.

For example, with data they're most likely using CouchDB for documents, Neo4j for graph data, Redis or BerkeleyDB as primary cache and MySQL/PGSQL/Oracle/whatever as their big data store, with only maybe 10% queries actually hitting it. Then you'll have multiple backends for various parts (Facebook has PHP running on HHVM, some Scala, Node and probably other things thrown into the mix). Then you have front-end tech like Angular or React added as another layer on top of that. To further leverage this complex architecture you have some form of ESB sprinkled into the mix. Then you start to think how it's spread over a gazillion servers with reverse proxies, DB replication etc. and you realize that it's one huge clusterfuck of a mess.

Nowadays you don't limit yourself to a single tech. You pick the tool that best suits your needs for specific parts and then build everything as SOA so you can pretend it's one huge app.


Thanks for the explanation. I decided I'd go with Java for now. I should remember it mostly in a week and then I'll practice on Spring and maybe struts.

I rethought the whole thing and I found that my problem is not that I don't know the language at all. Basically they all have the same syntax with minor differences. But I have 0 knowledge about used frameworks. The shit that really really matters.

Later I may check RoR or PHP my cake.
njt7
Profile Joined August 2012
Sweden769 Posts
August 29 2016 11:20 GMT
#15137
On August 26 2016 21:37 tofucake wrote:
Show nested quote +
On August 26 2016 14:31 Wrath wrote:
On August 26 2016 06:28 BisuDagger wrote:
On August 26 2016 06:20 Wrath wrote:
On August 26 2016 05:39 tofucake wrote:
it's single threaded, which is a huge issue


Why?

Google is a great resource for these types of questions. I know little about node and now im that much more informed after google research!

http://stackoverflow.com/questions/17959663/why-is-node-js-single-threaded


My question was why it is a huge issue not why it is a single threaded

If you're looking to do some standard website, node is a crap choice. Something like TL would go down in flames if it were made in node, nevermind any big site. Nobody will create the next Facebook/Google/Etsy/Ebay/PayPal/Expedia/Whatever until node gets multithreading.


Why would node go down in flames if it ran TL.net? My realworld test gave me about 20 requests/ second on a amazon micro instance. If you really need more just add more instances behind a load balancer. (might have been 50 requests/ second but honestly 20 is enough to prove my point isnt it?).
"All the casters who flamed me ever for anything."
Manit0u
Profile Blog Joined August 2004
Poland17249 Posts
August 29 2016 13:01 GMT
#15138
On August 29 2016 20:20 njt7 wrote:
Show nested quote +
On August 26 2016 21:37 tofucake wrote:
On August 26 2016 14:31 Wrath wrote:
On August 26 2016 06:28 BisuDagger wrote:
On August 26 2016 06:20 Wrath wrote:
On August 26 2016 05:39 tofucake wrote:
it's single threaded, which is a huge issue


Why?

Google is a great resource for these types of questions. I know little about node and now im that much more informed after google research!

http://stackoverflow.com/questions/17959663/why-is-node-js-single-threaded


My question was why it is a huge issue not why it is a single threaded

If you're looking to do some standard website, node is a crap choice. Something like TL would go down in flames if it were made in node, nevermind any big site. Nobody will create the next Facebook/Google/Etsy/Ebay/PayPal/Expedia/Whatever until node gets multithreading.


Why would node go down in flames if it ran TL.net? My realworld test gave me about 20 requests/ second on a amazon micro instance. If you really need more just add more instances behind a load balancer. (might have been 50 requests/ second but honestly 20 is enough to prove my point isnt it?).


I think that the biggest problem with single-threaded apps is consistency. If each request runs in a separate thread then you can expect the same request to take the same amount of time, not so much with queueing since you don't really control what's being executed when.

Another downside of single-threading is that if some process will crash your app it's going to crash it for everyone, not just a single instance.
Time is precious. Waste it wisely.
obesechicken13
Profile Blog Joined July 2008
United States10467 Posts
Last Edited: 2016-08-29 14:16:39
August 29 2016 14:15 GMT
#15139
Hey guys, I have a problem again.

I asked it here

So I'm building a data hub. Basically I want to store large amounts of data in a database.

In order to do that there are these pipes of data that my data providers have to make using my APIs.

I want to secure the APIs so I know who's making the streams and I can limit who makes them. As well as who can send to them. Does it make sense to do OAuth for the non-ingestion API methods and use an API key for the ingestion methods?

OAuth tokens tend to expire and ingestion of data is a long running process.

OAuth + API keys doesn't feel like the right solution since then there's 2 separate security protocols being used.

The other option I see right now is to force users to check the expiration time of their tokens and then try to refresh them if it's about to expire and they still need to send data.
I think in our modern age technology has evolved to become more addictive. The things that don't give us pleasure aren't used as much. Work was never meant to be fun, but doing it makes us happier in the long run.
mantequilla
Profile Blog Joined June 2012
Turkey779 Posts
Last Edited: 2016-08-29 14:21:09
August 29 2016 14:18 GMT
#15140
guys sorry to interrupt your debate about app server threads, but im gonna ask a newb cloud question:

As I see Azure has a way to programmatically control cloud resources/deployments (https://github.com/Azure/azure-sdk-for-java), I'm assuming other cloud providers would have too. Right now have a software that we deploy to cloud by hand (uploading by ftp). We want to sell this web app to numerous small-budget customers.

Do you think such a workflow possible/appropriate/viable:

We build a website that customers can buy our software through. After payment, using the cloud API's above, an instance of our app is deployed to cloud (creating required services like databases etc) and customer is given a domain name to access his product. All of this is done without any handwork.
Age of Mythology forever!
Prev 1 755 756 757 758 759 1031 Next
Please log in or register to reply.
Live Events Refresh
Next event in 8h 42m
[ Submit Event ]
Live Streams
Refresh
StarCraft: Brood War
Britney 37270
PianO 351
GuemChi 274
zelot 155
Backho 114
NaDa 45
Sharp 39
Sacsri 36
JulyZerg 22
Shine 21
[ Show more ]
Bale 13
Hm[arnc] 8
Dota 2
XcaliburYe293
NeuroSwarm102
ODPixel58
Counter-Strike
Stewie2K1246
Super Smash Bros
Mew2King193
Other Games
summit1g11348
SortOf62
Trikslyr27
Organizations
Other Games
gamesdonequick2890
StarCraft 2
Blizzard YouTube
StarCraft: Brood War
BSLTrovo
sctven
[ Show 16 non-featured ]
StarCraft 2
• Berry_CruncH408
• OhrlRock 6
• AfreecaTV YouTube
• intothetv
• Kozan
• IndyKCrew
• LaughNgamezSOOP
• Migwel
• sooper7s
StarCraft: Brood War
• iopq 1
• BSLYoutube
• STPLYoutube
• ZZZeroYoutube
Dota 2
• lizZardDota2181
League of Legends
• Stunt463
• HappyZerGling67
Upcoming Events
uThermal 2v2 Circuit
8h 42m
Replay Cast
16h 42m
The PondCast
1d 2h
OSC
1d 5h
WardiTV European League
1d 8h
Replay Cast
1d 16h
Epic.LAN
2 days
CranKy Ducklings
3 days
Epic.LAN
3 days
CSO Contender
3 days
[ Show More ]
BSL20 Non-Korean Champi…
3 days
Bonyth vs Sziky
Dewalt vs Hawk
Hawk vs QiaoGege
Sziky vs Dewalt
Mihu vs Bonyth
Zhanhun vs QiaoGege
QiaoGege vs Fengzi
Sparkling Tuna Cup
4 days
Online Event
4 days
BSL20 Non-Korean Champi…
4 days
Bonyth vs Zhanhun
Dewalt vs Mihu
Hawk vs Sziky
Sziky vs QiaoGege
Mihu vs Hawk
Zhanhun vs Dewalt
Fengzi vs Bonyth
Esports World Cup
6 days
ByuN vs Astrea
Lambo vs HeRoMaRinE
Clem vs TBD
Solar vs Zoun
SHIN vs Reynor
Maru vs TriGGeR
herO vs Lancer
Cure vs ShoWTimE
Liquipedia Results

Completed

CSL 17: 2025 SUMMER
RSL Revival: Season 1
Murky Cup #2

Ongoing

JPL Season 2
BSL 2v2 Season 3
Copa Latinoamericana 4
Jiahua Invitational
BSL20 Non-Korean Championship
Championship of Russia 2025
FISSURE Playground #1
BLAST.tv Austin Major 2025
ESL Impact League Season 7
IEM Dallas 2025
PGL Astana 2025
Asian Champions League '25
BLAST Rivals Spring 2025
MESA Nomadic Masters

Upcoming

CSL Xiamen Invitational
CSL Xiamen Invitational: ShowMatche
2025 ACS Season 2
CSLPRO Last Chance 2025
CSLPRO Chat StarLAN 3
BSL Season 21
K-Championship
RSL Revival: Season 2
SEL Season 2 Championship
uThermal 2v2 Main Event
FEL Cracov 2025
Esports World Cup 2025
Underdog Cup #2
ESL Pro League S22
StarSeries Fall 2025
FISSURE Playground #2
BLAST Open Fall 2025
BLAST Open Fall Qual
Esports World Cup 2025
BLAST Bounty Fall 2025
BLAST Bounty Fall Qual
IEM Cologne 2025
TLPD

1. ByuN
2. TY
3. Dark
4. Solar
5. Stats
6. Nerchio
7. sOs
8. soO
9. INnoVation
10. Elazer
1. Rain
2. Flash
3. EffOrt
4. Last
5. Bisu
6. Soulkey
7. Mini
8. Sharp
Sidebar Settings...

Advertising | Privacy Policy | Terms Of Use | Contact Us

Original banner artwork: Jim Warren
The contents of this webpage are copyright © 2025 TLnet. All Rights Reserved.