• Log InLog In
  • Register
Liquid`
Team Liquid Liquipedia
EDT 09:48
CEST 15:48
KST 22:48
  • Home
  • Forum
  • Calendar
  • Streams
  • Liquipedia
  • Features
  • Store
  • EPT
  • TL+
  • StarCraft 2
  • Brood War
  • Smash
  • Heroes
  • Counter-Strike
  • Overwatch
  • Liquibet
  • Fantasy StarCraft
  • TLPD
  • StarCraft 2
  • Brood War
  • Blogs
Forum Sidebar
Events/Features
News
Featured News
[ASL22] Ro16 Preview: Rough Waters10[ASL22] Ro24 Preview: Siren's Call8[ASL22] Ro24 Preview: Summer's End9Serral wins HomeStory Cup 2915Serral wins Maestros of the Game 244
Community News
StarCraft open world shooter announced at BlizzCon69Weekly Cups (Aug 30-Sep 7): herO thrives amid growing schism10Official StarCraft website teases new content ahead of BlizzCon?170Stellar Fest TWO the Moon (Dec 16-20)9Weekly Cups (August 24-30): Patches' balance mod takes over3
StarCraft 2
General
StarCraft open world shooter announced at BlizzCon How do you feel about the StarCraft shooter announcement at BlizzCon 2026? Balance hotfix patch 5.0.16b (July 16) Team Liquid Map Contest #22: Results and Winners Weekly Cups (Aug 30-Sep 7): herO thrives amid growing schism
Tourneys
Sparkling Tuna Cup - Weekly Open Tournament RSL goes to London! 2026 Offline Finals Nov 21-22 KSL Week #92 IntoTheTV X SOOP SC2 League : Weekly & Monthly 2026 GSTL Announcement
Strategy
[G] Having the right mentality to improve
Custom Maps
Nexus Wars 2021 GUIDE [M] (2) Industrial Park
External Content
The PondCast: SC2 News & Results Mutation # 542 The Ascended Mutation # 541 Binary Choice Mutation # 540 Dodge This
Brood War
General
Official StarCraft website teases new content ahead of BlizzCon? ASL22 General Discussion BGH Auto Balance -> http://bghmmr.eu/ Broodwar Prediction Market Practice Partners (Official)
Tourneys
[ASL22] Ro16 Group B [ASL22] Ro16 Group A Escore Tournament - Season 3 Small VOD Thread 2.0
Strategy
Replay Review Process - What do you do? Simple Questions, Simple Answers Odyssey Mineral Stack Saturation Game Theory for Starcraft
Other Games
General Games
Diablo IV Nintendo Switch Thread EVE Corporation [Maplestory Hardcore] Let's Play~!! General RTS Discussion Thread
Dota 2
Official 'what is Dota anymore' discussion
League of Legends
[TL LoL EUW IHs] Teemo shall perish TSM pausing esports and CLG Dead
Heroes of the Storm
Heroes of the Storm 2.0
Hearthstone
Deck construction bug
TL Mafia
TL Mafia Community Thread
Community
General
US Politics Mega-thread Things Aren’t Peaceful in Palestine Trading/Investing Thread UK Politics Mega-thread Russo-Ukrainian War Thread
Fan Clubs
MarineLorD Fan Club The Creator Fan Club The ShoWTimE Fan Club
Media & Entertainment
Movie Discussion! Diablo Animated Series on Netflix
Sports
Football (Soccer) Thread TeamLiquid Health and Fitness Initiative For 2023 MLB/Baseball 2023
World Cup 2022
Tech Support
Computer Build, Upgrade & Buying Resource Thread
TL Community
The Automated Ban List Northern Ireland Global Starcraft
Blogs
Virtual Romance, Real-Life C…
TrAiDoS
Regacy Esports:Our Goa…
regacyesports
Dreaming of BW patches (mod…
c3rberUs
LOCKPICKING NOOB
LUCKY_NOOB
Customize Sidebar...

Website Feedback

Closed Threads



Active: 7008 users

The Big Programming Thread - Page 650

Forum Index > General Forum
Post a Reply
Prev 1 648 649 650 651 652 1032 Next
Thread Rules
1. This is not a "do my homework for me" thread. If you have specific questions, ask, but don't post an assignment or homework problem and expect an exact solution.
2. No recruiting for your cockamamie projects (you won't replace facebook with 3 dudes you found on the internet and $20)
3. If you can't articulate why a language is bad, don't start slinging shit about it. Just remember that nothing is worse than making CSS IE6 compatible.
4. Use [code] tags to format code blocks.
ZenithM
Profile Joined February 2011
France15952 Posts
July 17 2015 14:10 GMT
#12981
On July 17 2015 22:52 BisuDagger wrote:
Show nested quote +
On July 17 2015 22:14 Acrofales wrote:
Almost fits: 149.49 * log(x + 1). The problem is that it increases slightly too fast, and 45 isn't at 225. However, looking at your picture, you don't want 45 at 225 anyway, but slightly over 270, in which case the log increases too slow. A curve fitter should be able to fit this, though, even with so few points. I'd chug it through scipy's curve fitter for you, but I don't have time. Here's the general function:

a + b*log(c*x + d). Give it the following points: f(0) = 0, f(3) = 90, f(15) = 180, f(40) = 270.

Edit: if there is no way of scaling the log to fit these points properly, try a root:

a + b*x^(1/c)

You are correct, I had to edit my post to show 40 @ 270 degrees. I am going to check out scipy's curve fitter. Never heard of it before now.

Show nested quote +
On July 17 2015 22:16 ZenithM wrote:
AngleInDegrees = 10 * (gaugeValue * 50)^0.44 - (something)
with something being between 0 and 4, which ever looks better ;D

I'd try a root in any case.


What I have trouble wrapping my head around is a formula that tackles the whole range at once. Because between 2-5 the difference is 3, 10-15 the difference is 5, 15 to 25 the difference is 10, but then it descales 25-30 a difference of 5, and then 30-40 a difference of 10 lol. If it scaled where the difference was 1,2,3,5,5,10,10,10 that'd be a little be easier to work with.

Anyway, the code I wrote was easily cleaned up. That was written long form just for me to visual see what was happening. Now it is relatively clean and now I see I could even do better but I already committed it and moved on lol.


else if (needlePosition > 25 && needlePosition <= 30)
{
float scaleToMeter = ScaleToDegrees(25, 30, rotate25, rotate30, needlePosition);
this.transform.Rotate(Vector3.right, scaleToMeter);
}

You're right I hadn't looked at the gauge closely enough. You're probably better off hard coding it (like you did, it sounds fine) or picking another gauge picture ;D.
BisuDagger
Profile Blog Joined October 2009
Bisutopia19384 Posts
July 17 2015 14:15 GMT
#12982
On July 17 2015 23:10 ZenithM wrote:
Show nested quote +
On July 17 2015 22:52 BisuDagger wrote:
On July 17 2015 22:14 Acrofales wrote:
Almost fits: 149.49 * log(x + 1). The problem is that it increases slightly too fast, and 45 isn't at 225. However, looking at your picture, you don't want 45 at 225 anyway, but slightly over 270, in which case the log increases too slow. A curve fitter should be able to fit this, though, even with so few points. I'd chug it through scipy's curve fitter for you, but I don't have time. Here's the general function:

a + b*log(c*x + d). Give it the following points: f(0) = 0, f(3) = 90, f(15) = 180, f(40) = 270.

Edit: if there is no way of scaling the log to fit these points properly, try a root:

a + b*x^(1/c)

You are correct, I had to edit my post to show 40 @ 270 degrees. I am going to check out scipy's curve fitter. Never heard of it before now.

On July 17 2015 22:16 ZenithM wrote:
AngleInDegrees = 10 * (gaugeValue * 50)^0.44 - (something)
with something being between 0 and 4, which ever looks better ;D

I'd try a root in any case.


What I have trouble wrapping my head around is a formula that tackles the whole range at once. Because between 2-5 the difference is 3, 10-15 the difference is 5, 15 to 25 the difference is 10, but then it descales 25-30 a difference of 5, and then 30-40 a difference of 10 lol. If it scaled where the difference was 1,2,3,5,5,10,10,10 that'd be a little be easier to work with.

Anyway, the code I wrote was easily cleaned up. That was written long form just for me to visual see what was happening. Now it is relatively clean and now I see I could even do better but I already committed it and moved on lol.


else if (needlePosition > 25 && needlePosition <= 30)
{
float scaleToMeter = ScaleToDegrees(25, 30, rotate25, rotate30, needlePosition);
this.transform.Rotate(Vector3.right, scaleToMeter);
}

You're right I hadn't looked at the gauge closely enough. You're probably better off hard coding it (like you did, it sounds fine) or picking another gauge picture ;D.

I'm sure I could ask Boeing to redesign their aircraft for me. Lol.
ModeratorFormer Afreeca Starleague Caster: http://afreeca.tv/ASL2ENG2
ZenithM
Profile Joined February 2011
France15952 Posts
July 17 2015 14:24 GMT
#12983
Haha tough luck then. I hope airplane web browsers handle HTML 5 + Javascript. I wouldn't dare to ask my pilot to trust Adobe Flash gauge readings.
BisuDagger
Profile Blog Joined October 2009
Bisutopia19384 Posts
July 17 2015 14:26 GMT
#12984
On July 17 2015 23:24 ZenithM wrote:
Haha tough luck then. I hope airplane web browsers handle HTML 5 + Javascript. I wouldn't dare to ask my pilot to trust Adobe Flash gauge readings.

This is done in unity which has HTML5 support. :D
ModeratorFormer Afreeca Starleague Caster: http://afreeca.tv/ASL2ENG2
Manit0u
Profile Blog Joined August 2004
Poland17843 Posts
July 17 2015 19:22 GMT
#12985
Shouldn't it be analog in the first place?
Time is precious. Waste it wisely.
Acrofales
Profile Joined August 2010
Spain18438 Posts
July 17 2015 19:28 GMT
#12986
On July 17 2015 23:10 ZenithM wrote:
Show nested quote +
On July 17 2015 22:52 BisuDagger wrote:
On July 17 2015 22:14 Acrofales wrote:
Almost fits: 149.49 * log(x + 1). The problem is that it increases slightly too fast, and 45 isn't at 225. However, looking at your picture, you don't want 45 at 225 anyway, but slightly over 270, in which case the log increases too slow. A curve fitter should be able to fit this, though, even with so few points. I'd chug it through scipy's curve fitter for you, but I don't have time. Here's the general function:

a + b*log(c*x + d). Give it the following points: f(0) = 0, f(3) = 90, f(15) = 180, f(40) = 270.

Edit: if there is no way of scaling the log to fit these points properly, try a root:

a + b*x^(1/c)

You are correct, I had to edit my post to show 40 @ 270 degrees. I am going to check out scipy's curve fitter. Never heard of it before now.

On July 17 2015 22:16 ZenithM wrote:
AngleInDegrees = 10 * (gaugeValue * 50)^0.44 - (something)
with something being between 0 and 4, which ever looks better ;D

I'd try a root in any case.


What I have trouble wrapping my head around is a formula that tackles the whole range at once. Because between 2-5 the difference is 3, 10-15 the difference is 5, 15 to 25 the difference is 10, but then it descales 25-30 a difference of 5, and then 30-40 a difference of 10 lol. If it scaled where the difference was 1,2,3,5,5,10,10,10 that'd be a little be easier to work with.

Anyway, the code I wrote was easily cleaned up. That was written long form just for me to visual see what was happening. Now it is relatively clean and now I see I could even do better but I already committed it and moved on lol.


else if (needlePosition > 25 && needlePosition <= 30)
{
float scaleToMeter = ScaleToDegrees(25, 30, rotate25, rotate30, needlePosition);
this.transform.Rotate(Vector3.right, scaleToMeter);
}

You're right I hadn't looked at the gauge closely enough. You're probably better off hard coding it (like you did, it sounds fine) or picking another gauge picture ;D.


Yup. I also completely missed that. What weird underlying analog process led to that being a good distribution on the dial?! How do you calibrate that correctly? :O
Sufficiency
Profile Blog Joined October 2010
Canada23833 Posts
Last Edited: 2015-07-17 23:40:26
July 17 2015 23:39 GMT
#12987
Hi TL,

Sorry this isn't "exactly" programming, but I am looking for a "serious" SQL book to study from. What I mean by "serious" is that I know how to write SQL statements, but I want to understand how to write fast and efficient SQL statements and know some deeper level tricks. Basically, I am interested in becoming an expert user, but not a DBA - if that makes any sense.

As far as SQL vendor specificity is concerned, lack of specificity is preferred, but PostgreSQL or Oracle specific would be fine by me as well.

Thanks in advance.
https://twitter.com/SufficientStats
sabas123
Profile Blog Joined December 2010
Netherlands3122 Posts
July 17 2015 23:52 GMT
#12988
On July 18 2015 08:39 Sufficiency wrote:
Hi TL,

Sorry this isn't "exactly" programming, but I am looking for a "serious" SQL book to study from. What I mean by "serious" is that I know how to write SQL statements, but I want to understand how to write fast and efficient SQL statements and know some deeper level tricks. Basically, I am interested in becoming an expert user, but not a DBA - if that makes any sense.

As far as SQL vendor specificity is concerned, lack of specificity is preferred, but PostgreSQL or Oracle specific would be fine by me as well.

Thanks in advance.

I don't know any of such books, but I think your best bet would be learning how databases work?
The harder it becomes, the more you should focus on the basics.
Sufficiency
Profile Blog Joined October 2010
Canada23833 Posts
July 17 2015 23:55 GMT
#12989
On July 18 2015 08:52 sabas123 wrote:
Show nested quote +
On July 18 2015 08:39 Sufficiency wrote:
Hi TL,

Sorry this isn't "exactly" programming, but I am looking for a "serious" SQL book to study from. What I mean by "serious" is that I know how to write SQL statements, but I want to understand how to write fast and efficient SQL statements and know some deeper level tricks. Basically, I am interested in becoming an expert user, but not a DBA - if that makes any sense.

As far as SQL vendor specificity is concerned, lack of specificity is preferred, but PostgreSQL or Oracle specific would be fine by me as well.

Thanks in advance.

I don't know any of such books, but I think your best bet would be learning how databases work?


I guess that would make sense - to learn its theories. I am sure there are tons of books on this, but any recommendations?
https://twitter.com/SufficientStats
Chocolate
Profile Blog Joined December 2010
United States2350 Posts
July 18 2015 01:31 GMT
#12990
On July 18 2015 08:39 Sufficiency wrote:
Hi TL,

Sorry this isn't "exactly" programming, but I am looking for a "serious" SQL book to study from. What I mean by "serious" is that I know how to write SQL statements, but I want to understand how to write fast and efficient SQL statements and know some deeper level tricks. Basically, I am interested in becoming an expert user, but not a DBA - if that makes any sense.

As far as SQL vendor specificity is concerned, lack of specificity is preferred, but PostgreSQL or Oracle specific would be fine by me as well.

Thanks in advance.

I'm not a SQL expert by any means but in my databases course we were taught that typically SQL implementations have a built in optimizer that usually does most of that for you.
Sufficiency
Profile Blog Joined October 2010
Canada23833 Posts
Last Edited: 2015-07-18 03:34:11
July 18 2015 03:33 GMT
#12991
On July 18 2015 10:31 Chocolate wrote:
Show nested quote +
On July 18 2015 08:39 Sufficiency wrote:
Hi TL,

Sorry this isn't "exactly" programming, but I am looking for a "serious" SQL book to study from. What I mean by "serious" is that I know how to write SQL statements, but I want to understand how to write fast and efficient SQL statements and know some deeper level tricks. Basically, I am interested in becoming an expert user, but not a DBA - if that makes any sense.

As far as SQL vendor specificity is concerned, lack of specificity is preferred, but PostgreSQL or Oracle specific would be fine by me as well.

Thanks in advance.

I'm not a SQL expert by any means but in my databases course we were taught that typically SQL implementations have a built in optimizer that usually does most of that for you.


Is it really that simple though?

For example, are the following three queries the same in terms of performance?

1.

SELECT a.row_a1, b.row_b1
FROM table_a a
INNER JOIN table_b b
ON a.id = b.id and b.row_b2 = 1


2.

SELECT a.row_a1, b.row_b1
FROM table_a a
INNER JOIN (SELECT * FROM table_b where row_b2 = 1) b
ON a.id = b.id


3.

SELECT a.row_a1, b.row_b1
FROM table_a a
INNER JOIN table_b b
ON a.id = b.id and b.row_b2 = 1
WHERE b.row_b2 = 1


My impression is that 2 is better if table_b is big. I don't really know if there is a difference between 1 and 3 performance wise.
https://twitter.com/SufficientStats
Chocolate
Profile Blog Joined December 2010
United States2350 Posts
Last Edited: 2015-07-18 04:11:23
July 18 2015 04:03 GMT
#12992
Look up this thing called relational algebra. Basically my impression is that SQL implementations use relational algebra to reduce / simplify most expressions that are effectively equal, which means they end up similar or equivalent to the DB when it actually executes the queries.
wherebugsgo
Profile Blog Joined February 2010
Japan10647 Posts
Last Edited: 2015-07-18 05:01:48
July 18 2015 05:01 GMT
#12993
what do you guys do when you start a new job and want to ramp up quickly?

I've been taking notes each day in a gdoc and been trying to make a daily recap of the top 3 things I did. Been pretty useful so far but it still feels so shitty to go from being a TL on a project at a different company to knowing absolutely nothing (have to learn entirely new proprietary tech mostly) in a position where everyone tells me it'll take around 6 months to do anything useful.
phar
Profile Joined August 2011
United States1080 Posts
July 18 2015 05:35 GMT
#12994
read docs (if there are any), read code

Get someone to walk you through standing up a local system end to end. Fix some small bug(s).

Even at a place running an entirely internal stack, you should be able to make some impact in << 6 months...
Who after all is today speaking about the destruction of the Armenians?
wherebugsgo
Profile Blog Joined February 2010
Japan10647 Posts
Last Edited: 2015-07-18 05:53:57
July 18 2015 05:52 GMT
#12995
yea I don't mean make no impact within 6 months but not really pull my weight for 6 months. I've heard varying estimates from my colleagues and some friends who work/have worked here and the consensus seems to be 3-6 months ramp up time to at least not feel like you're just treading water the whole time.

At my previous work it was about a month for me but this is definitely a different beast. Everyone here is way smarter than I am lol

also I'm in a slightly different role, not really SWE. My team is like half SWE half SRE across three different continents...it's actually pretty surreal
r3dox
Profile Blog Joined May 2003
Germany261 Posts
July 18 2015 08:08 GMT
#12996
On July 18 2015 14:01 wherebugsgo wrote:
what do you guys do when you start a new job and want to ramp up quickly?.


ask devs to look over their shoulder / do pair programming on "Routine" Tasks in the code base / System. And let them explain most of their steps how/why they do it etc. ask questions while they do it

Do code Review on small Features / bug fixes and understand why that requirement needed to touch all the places it did.
If there are Overall architecture / design Meetings / discussions listen in from time to time.
teamamerica
Profile Blog Joined July 2010
United States958 Posts
Last Edited: 2015-07-18 08:35:49
July 18 2015 08:21 GMT
#12997
On July 18 2015 12:33 Sufficiency wrote:
Show nested quote +
On July 18 2015 10:31 Chocolate wrote:
On July 18 2015 08:39 Sufficiency wrote:
Hi TL,

Sorry this isn't "exactly" programming, but I am looking for a "serious" SQL book to study from. What I mean by "serious" is that I know how to write SQL statements, but I want to understand how to write fast and efficient SQL statements and know some deeper level tricks. Basically, I am interested in becoming an expert user, but not a DBA - if that makes any sense.

As far as SQL vendor specificity is concerned, lack of specificity is preferred, but PostgreSQL or Oracle specific would be fine by me as well.

Thanks in advance.

I'm not a SQL expert by any means but in my databases course we were taught that typically SQL implementations have a built in optimizer that usually does most of that for you.


Is it really that simple though?

For example, are the following three queries the same in terms of performance?

1.

SELECT a.row_a1, b.row_b1
FROM table_a a
INNER JOIN table_b b
ON a.id = b.id and b.row_b2 = 1


2.

SELECT a.row_a1, b.row_b1
FROM table_a a
INNER JOIN (SELECT * FROM table_b where row_b2 = 1) b
ON a.id = b.id


3.

SELECT a.row_a1, b.row_b1
FROM table_a a
INNER JOIN table_b b
ON a.id = b.id and b.row_b2 = 1
WHERE b.row_b2 = 1


My impression is that 2 is better if table_b is big. I don't really know if there is a difference between 1 and 3 performance wise.


On July 18 2015 12:33 Sufficiency wrote:
Show nested quote +
On July 18 2015 10:31 Chocolate wrote:
On July 18 2015 08:39 Sufficiency wrote:
Hi TL,

Sorry this isn't "exactly" programming, but I am looking for a "serious" SQL book to study from. What I mean by "serious" is that I know how to write SQL statements, but I want to understand how to write fast and efficient SQL statements and know some deeper level tricks. Basically, I am interested in becoming an expert user, but not a DBA - if that makes any sense.

As far as SQL vendor specificity is concerned, lack of specificity is preferred, but PostgreSQL or Oracle specific would be fine by me as well.

Thanks in advance.

I'm not a SQL expert by any means but in my databases course we were taught that typically SQL implementations have a built in optimizer that usually does most of that for you.


Is it really that simple though?

For example, are the following three queries the same in terms of performance?

1.

SELECT a.row_a1, b.row_b1
FROM table_a a
INNER JOIN table_b b
ON a.id = b.id and b.row_b2 = 1


2.

SELECT a.row_a1, b.row_b1
FROM table_a a
INNER JOIN (SELECT * FROM table_b where row_b2 = 1) b
ON a.id = b.id


3.

SELECT a.row_a1, b.row_b1
FROM table_a a
INNER JOIN table_b b
ON a.id = b.id and b.row_b2 = 1
WHERE b.row_b2 = 1


My impression is that 2 is better if table_b is big. I don't really know if there is a difference between 1 and 3 performance wise.


I can't imagine a case where query optimizer doesn't put 1st and 3rd to same. I get same query plan for both over a few different combinations I tried.

Without knowing more of your schema it's really impossible to say which would be faster though (1st/3rd or 2nd). It's a function of indices on your table, the size of the tables, the last time you might have run gather stats or analyze on your table -- all these factors go into what to query plan optimizer decides to execute.

For example, if I have an index on table b, column b.id, b.row_2 then for me, 1st,3rd query blows 2nd query out of water in my testing. Because in that case, MySQL is able to use that index, but with the subquery it's not smart enough. But that's in my case. I really can't say for sure what it might decide to do as table grows much larger. I'm not DBA at work but I know they running into issues with query plans changing as table size grows (but that's Oracle).

The MySQL refpages have probably been on of the most useful things for me, If you really want to become an expert, you should read the refpages for your specific database, since as you can see, queries that reduce to the same result set can be executed differently and that result really comes down to the DB you're using to get the most out of it.

Here's a transcipt of me talking to my database trying a few queries, but in general this is useless to anyone not me since your database will have different indices, table size, and useage patterns.

Sorry I don't have any exact advice, just thought I'd throw in my 2cents.

edit: some practical links:
http://patshaughnessy.net/2014/11/11/discovering-the-computer-science-behind-postgres-indexes
http://use-the-index-luke.com/

+ Show Spoiler +

ysql> SELECT COUNT(*) FROM replays_buid;
ERROR 1146 (42S02): Table 'app.replays_buid' doesn't exist
mysql> SELECT COUNT(*) FROM replays_buildevent;
+----------+
| COUNT(*) |
+----------+
| 7193800 |
+----------+
1 row in set (5.09 sec)

mysql> SELECT COUNT(*) FROM replays_build;
+----------+
| COUNT(*) |
+----------+
| 26507 |
+----------+
1 row in set (0.02 sec)

mysql> SELECT COUNT(b.id)
-> FROM replays_build b
-> INNER JOIN (SELECT * FROM replays_buildevent be WHERE be.name = "SCV") be ON b.id = be.build_id;
+-------------+
| COUNT(b.id) |
+-------------+
| 457551 |
+-------------+
1 row in set (28.22 sec)

mysql> SELECT COUNT(b.id)
-> FROM replays_build b
-> JOIN replays_buildevent be ON b.id = be.build_id
-> WHERE be.name = "SCV";
+-------------+
| COUNT(b.id) |
+-------------+
| 457551 |
+-------------+
1 row in set (0.99 sec)

mysql> SELECT COUNT(*)
-> FROM replays_build b
-> INNER JOIN (SELECT * FROM replays_buildevent be WHERE be.name = "SCV") be ON b.match_id = be.time;
+----------+
| COUNT(*) |
+----------+
| 910866 |
+----------+
1 row in set (38.02 sec)

mysql> SELECT COUNT(b.id)
-> FROM replays_build b
-> JOIN replays_buildevent be ON b.match_id = be.time
-> WHERE be.name = "SCV";
+-------------+
| COUNT(b.id) |
+-------------+
| 910866 |
+-------------+
1 row in set (18.82 sec)

mysql> EXPLAIN EXTENDED
-> SELECT COUNT(b.id)
-> FROM replays_build b
-> JOIN replays_buildevent be ON b.match_id = be.time
-> WHERE be.name = "SCV";
+----+-------------+-------+------+------------------------+------------------------+---------+-------------+---------+----------+-------------+
| id | select_type | table | type | possible_keys | key | key_len | ref | rows | filtered | Extra |
+----+-------------+-------+------+------------------------+------------------------+---------+-------------+---------+----------+-------------+
| 1 | SIMPLE | be | ALL | NULL | NULL | NULL | NULL | 6227388 | 100.00 | Using where |
| 1 | SIMPLE | b | ref | replays_build_ff9c4e4a | replays_build_ff9c4e4a | 4 | app.be.time | 1 | 100.00 | Using index |
+----+-------------+-------+------+------------------------+------------------------+---------+-------------+---------+----------+-------------+
2 rows in set, 1 warning (0.00 sec)

mysql> EXPLAIN EXTENDED
-> SELECT COUNT(*)
-> FROM replays_build b
-> INNER JOIN (SELECT * FROM replays_buildevent be WHERE be.name = "SCV") be ON b.match_id = be.time;
+----+-------------+------------+-------+------------------------+------------------------+---------+----------------+---------+----------+-------------+
| id | select_type | table | type | possible_keys | key | key_len | ref | rows | filtered | Extra |
+----+-------------+------------+-------+------------------------+------------------------+---------+----------------+---------+----------+-------------+
| 1 | PRIMARY | b | index | replays_build_ff9c4e4a | replays_build_ff9c4e4a | 4 | NULL | 24545 | 100.00 | Using index |
| 1 | PRIMARY | <derived2> | ref | <auto_key0> | <auto_key0> | 4 | app.b.match_id | 253 | 100.00 | NULL |
| 2 | DERIVED | be | ALL | NULL | NULL | NULL | NULL | 6227388 | 100.00 | Using where |
+----+-------------+------------+-------+------------------------+------------------------+---------+----------------+---------+----------+-------------+
3 rows in set, 1 warning (0.00 sec)

mysql> EXPLAIN EXTENDED
-> SELECT COUNT(b.id)
-> FROM replays_build b
-> JOIN replays_buildevent be ON b.id = be.build_id
-> WHERE be.name = "SCV";
+----+-------------+-------+-------+---------------+------------------------+---------+----------------+-------+----------+--------------------------+
| id | select_type | table | type | possible_keys | key | key_len | ref | rows | filtered | Extra |
+----+-------------+-------+-------+---------------+------------------------+---------+----------------+-------+----------+--------------------------+
| 1 | SIMPLE | b | index | PRIMARY | replays_build_ff9c4e4a | 4 | NULL | 24545 | 100.00 | Using index |
| 1 | SIMPLE | be | ref | build_name | build_name | 771 | app.b.id,const | 5 | 100.00 | Using where; Using index |
+----+-------------+-------+-------+---------------+------------------------+---------+----------------+-------+----------+--------------------------+
2 rows in set, 1 warning (0.00 sec)

mysql> SELECT COUNT(b.id)
-> FROM replays_build b
-> INNER JOIN (SELECT * FROM replays_buildevent be WHERE be.name = "SCV") be ON b.id = be.build_id;
+-------------+
| COUNT(b.id) |
+-------------+
| 457551 |
+-------------+
1 row in set (27.81 sec)

mysql> EXPLAIN EXTENDED
-> SELECT COUNT(b.id)
-> FROM replays_build b
-> INNER JOIN (SELECT * FROM replays_buildevent be WHERE be.name = "SCV") be ON b.id = be.build_id;
+----+-------------+------------+-------+---------------+------------------------+---------+----------+---------+----------+-------------+
| id | select_type | table | type | possible_keys | key | key_len | ref | rows | filtered | Extra |
+----+-------------+------------+-------+---------------+------------------------+---------+----------+---------+----------+-------------+
| 1 | PRIMARY | b | index | PRIMARY | replays_build_ff9c4e4a | 4 | NULL | 24545 | 100.00 | Using index |
| 1 | PRIMARY | <derived2> | ref | <auto_key0> | <auto_key0> | 4 | app.b.id | 253 | 100.00 | NULL |
| 2 | DERIVED | be | ALL | NULL | NULL | NULL | NULL | 6227388 | 100.00 | Using where |
+----+-------------+------------+-------+---------------+------------------------+---------+----------+---------+----------+-------------+
3 rows in set, 1 warning (0.00 sec)
RIP GOMTV. RIP PROLEAGUE.
Manit0u
Profile Blog Joined August 2004
Poland17843 Posts
Last Edited: 2015-07-18 08:42:44
July 18 2015 08:32 GMT
#12998
On July 18 2015 12:33 Sufficiency wrote:
Show nested quote +
On July 18 2015 10:31 Chocolate wrote:
On July 18 2015 08:39 Sufficiency wrote:
Hi TL,

Sorry this isn't "exactly" programming, but I am looking for a "serious" SQL book to study from. What I mean by "serious" is that I know how to write SQL statements, but I want to understand how to write fast and efficient SQL statements and know some deeper level tricks. Basically, I am interested in becoming an expert user, but not a DBA - if that makes any sense.

As far as SQL vendor specificity is concerned, lack of specificity is preferred, but PostgreSQL or Oracle specific would be fine by me as well.

Thanks in advance.

I'm not a SQL expert by any means but in my databases course we were taught that typically SQL implementations have a built in optimizer that usually does most of that for you.


Is it really that simple though?

For example, are the following three queries the same in terms of performance?

1.

SELECT a.row_a1, b.row_b1
FROM table_a a
INNER JOIN table_b b
ON a.id = b.id and b.row_b2 = 1


2.

SELECT a.row_a1, b.row_b1
FROM table_a a
INNER JOIN (SELECT * FROM table_b where row_b2 = 1) b
ON a.id = b.id


3.

SELECT a.row_a1, b.row_b1
FROM table_a a
INNER JOIN table_b b
ON a.id = b.id and b.row_b2 = 1
WHERE b.row_b2 = 1


My impression is that 2 is better if table_b is big. I don't really know if there is a difference between 1 and 3 performance wise.


It also depends on what kind of data you want from the DB. You could look up some database abstraction stuff and see how they do things (Doctrine is open source, you could definitely check out their hydration modes). It's fairly important to not only optimize your queries, it's just as important to reduce the number of queries and to get back only the stuff you need, without superfluous things.

Some most useful stuff includes COUNT, CONCAT, HAVING and GROUP BY.

Too many times I've seen code execute the query only to do stupid stuff like that:


$query = $queryBuilder
->select('o') // that's equal to *
->from('myTable')
->where('statement)
->getQuery();

$result = $query->getResult();

return count($result);


What it should be:


$query = $queryBuilder
->select('COUNT(o.id)')
->from('myTable')
->where('statement)
->getQuery();

$result = $query->getSingleScalarResult();

return $result;


CONCAT is likewise useful, when you want to display the user's first name + last name for example. Instead of doing concatenation later in the code you can simply select "CONCAT('u.first_name', ' ', 'u.last_name') AS name" and work with that.

You also don't always need objects and should use stuff like getArrayResult() (still speaking about Doctrine since I can't really live without some form of DBAL any more).

Another really important thing is query parametrization. So that you can reuse your queries for different data.


SELECT * FROM Orders WHERE CustomerID =?



INSERT INTO Employees(LastName, FirstName, Title, TitleOfCourtesy,
BirthDate, HireDate, Address, City, Region, PostalCode, Country,
HomePhone, Extension, Photo, Notes, ReportsTo, PhotoPath, rowguid)
VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)


As a bonus, I present you with this most interesting study regarding DB performance when storing dates and times (tldr: never use timestamps in your db).
Time is precious. Waste it wisely.
phar
Profile Joined August 2011
United States1080 Posts
Last Edited: 2015-07-18 19:45:17
July 18 2015 19:41 GMT
#12999
On July 18 2015 14:52 wherebugsgo wrote:
yea I don't mean make no impact within 6 months but not really pull my weight for 6 months. I've heard varying estimates from my colleagues and some friends who work/have worked here and the consensus seems to be 3-6 months ramp up time to at least not feel like you're just treading water the whole time.

At my previous work it was about a month for me but this is definitely a different beast. Everyone here is way smarter than I am lol

also I'm in a slightly different role, not really SWE. My team is like half SWE half SRE across three different continents...it's actually pretty surreal

Send me a PM, if you're working where I think you're working. There are likely resources internally that can help you out.


Also it is normal (nay, required) for SRE teams to be split across continents, here is the logic:

1) SRE oncall is real (hard core) on call, with proper SLO/SLA for all systems, and for answering pages. That means in normal dev land, if a SWE is on call and a page happens, and they don't answer for 15 minutes maybe it's ok. Oftentimes (depending on the level of requirement) an SRE is acking that shit in like a minute. That means you can't even go take a shit or drive home without clearing it with secondary.

2) You want your SRE to be awake and able to actually triage & solve production issues ASAP when answering a page. (For example an on-call dev waking up at 3 am is not going to actually solve any problem for like 30 minutes, because 3am you're groggy).

-> The solution here is time zone rotations. Some SRE teams will be split across 2 timezones (west coast & Europe is common) later in the evening. West coast on call during daylight hours there, then swap to Europe in the evening. Rinse & repeat. More expansive SRE teams will be split across 3 timezones (usually Australia or the like), only 8 hour shifts.



All that does make it hard to coordinate, because remote teammates can be harder to work with. Requires a lot of proactive communication. Also helps if you get to fly around and meet up with everyone, see what everybody's like in person. You'll realize that for the most part people do have your back, and are interested in helping you succeed - while remotely over email/code reviews/im, people can seem a bit more terse & not as helpful.
Who after all is today speaking about the destruction of the Armenians?
Manit0u
Profile Blog Joined August 2004
Poland17843 Posts
Last Edited: 2015-07-18 22:10:45
July 18 2015 22:06 GMT
#13000
Damn guys, you're using all those acronyms... Could you at least explain what they mean? Google returns way too many possibilities and I'm genuinely curious here.

Random rant continued: Client presentation due the day after tomorrow, had to pull another saturday workday until 7pm, ux designer, half of the devs and all front-end people are on vacation, app looks like shit because every back-end dev was like "functionality is working, I'll just dump all the results wherever to prove it, let the front-end handle it" (I'm part of back-end too, but I had some experience with front-end so I at least made my stuff a bit more managable). My heart says it's fine, my brain says otherwise. Especially that (unlike most clients), this one sent a guy who was developing business apps for a living for years to act as their guy (the very first question he asked was "What's your test coverage?").

I really do feel rather grimdark right now.
Time is precious. Waste it wisely.
Prev 1 648 649 650 651 652 1032 Next
Please log in or register to reply.
Live Events Refresh
WardiTV Invitational
11:00
Pre Blizzcon Cup
Classic vs ByuNLIVE!
WardiTV1375
IntoTheiNu 1102
Rex147
Liquipedia
[ Submit Event ]
Live Streams
Refresh
StarCraft 2
Rex 147
MindelVK 36
StarCraft: Brood War
Britney 55550
Calm 5868
PianO 2827
Jaedong 944
Hyuk 493
firebathero 274
Last 207
Hyun 197
Pusan 153
ggaemo 149
[ Show more ]
Mini 148
Mong 45
Sharp 40
sSak 32
Killer 32
NaDa 30
HiyA 29
Rock 19
JulyZerg 17
Shine 16
Hm[arnc] 14
SilentControl 14
Icarus 9
ajuk12(nOOB) 8
Dota 2
qojqva2610
syndereN476
Fuzer 265
Counter-Strike
zeus523
Other Games
Happy678
DeMusliM357
Hui .155
QueenE43
Organizations
Other Games
BasetradeTV220
[ Show 11 non-featured ]
StarCraft 2
• Adnapsc2 34
• AfreecaTV YouTube
• intothetv
• Kozan
• IndyKCrew
• Migwel
StarCraft: Brood War
• BSLYoutube
• STPLYoutube
• ZZZeroYoutube
Dota 2
• WagamamaTV557
League of Legends
• Nemesis2152
Upcoming Events
Shopify Rebellion Sundays
1h 12m
Spirit vs Mixu
Clem vs TBD
RSL Revival
2h 12m
Serral vs Rogue
BlizzCon
4h 42m
IdrA vs MC
Afreeca Starleague
20h 12m
Light vs JyJ
Soulkey vs hero
WardiTV Weekly
21h 12m
Monday Night Weeklies
1d 2h
Afreeca Starleague
1d 20h
Snow vs Shinee
Shine vs EffOrt
GSL
1d 21h
PiGosaur Cup
2 days
The PondCast
2 days
[ Show More ]
Kung Fu Cup
2 days
Replay Cast
3 days
KCM Race Survival
3 days
IntoTheTV X SOOP
3 days
Replay Cast
4 days
IntoTheTV X SOOP
4 days
Replay Cast
5 days
GSL
5 days
Replay Cast
6 days
GSL
6 days
Liquipedia Results

Completed

Acropolis #5 - TRS
PiG Sty Festival 8.0
Big Dog Cup 2026 Div 1

Ongoing

KCM Race Survival 2026 Season 3
K-JUNGMAN
ASL Season 22
Super Anchor Qualifying S3
CSL 2026 AUTUMN (S22)
Acropolis #5
Blizzard Classic Cup 2026
Blizzard Classic Cup 2026
RSL Revival: Season 6
Calamity Invitational
FISSURE Playground #3
BLAST Open Fall 2026
Esports World Cup 2026
BLAST Bounty Summer 2026
BLAST Bounty Summer Qual
Stake Ranked Episode 3
XSE Pro League 2026

Upcoming

Acropolis #5 - GSA
Acropolis #5 - GSB
Acropolis #5 - GSC
SC4ALL II: Brood War
HSC XXX
Stellar Fest 2: Lunar Cup
SC4ALL II: StarCraft II
Kung Fu Cup 2026 Grand Finals
RSL Offline Finals
PGL Major Singapore 2026
Stake Ranked Episode 6
BLAST Rivals Fall 2026
IEM Beijing 2026
Stake Ranked Episode 5
PGL Masters Bucharest 2026
1win Private Club #2
Thunderpick World Champ. '26
ESL Pro League Season 24
Stake Ranked Episode 4
1win Private Club #1
Logitech G Play Connect 2026
SL StarSeries Fall 2026
TLPD

1. ByuN
2. TY
3. Dark
4. Solar
5. Stats
6. Nerchio
7. sOs
8. soO
9. INnoVation
10. Elazer
1. Rain
2. Flash
3. EffOrt
4. Last
5. Bisu
6. Soulkey
7. Mini
8. Sharp
Sidebar Settings...

Advertising | Privacy Policy | Terms Of Use | Contact Us

Original banner artwork: Jim Warren
The contents of this webpage are copyright © 2026 TLnet. All Rights Reserved.