• Log InLog In
  • Register
Liquid`
Team Liquid Liquipedia
EDT 16:20
CEST 22:20
KST 05:20
  • Home
  • Forum
  • Calendar
  • Streams
  • Liquipedia
  • Features
  • Store
  • EPT
  • TL+
  • StarCraft 2
  • Brood War
  • Smash
  • Heroes
  • Counter-Strike
  • Overwatch
  • Liquibet
  • Fantasy StarCraft
  • TLPD
  • StarCraft 2
  • Brood War
  • Blogs
Forum Sidebar
Events/Features
News
Featured News
[ASL19] Finals Recap: Standing Tall9HomeStory Cup 27 - Info & Preview18Classic wins Code S Season 2 (2025)16Code S RO4 & Finals Preview: herO, Rogue, Classic, GuMiho0TL Team Map Contest #5: Presented by Monster Energy6
Community News
Flash Announces Hiatus From ASL49Weekly Cups (June 23-29): Reynor in world title form?12FEL Cracov 2025 (July 27) - $8000 live event16Esports World Cup 2025 - Final Player Roster16Weekly Cups (June 16-22): Clem strikes back1
StarCraft 2
General
The SCII GOAT: A statistical Evaluation Statistics for vetoed/disliked maps Esports World Cup 2025 - Final Player Roster How does the number of casters affect your enjoyment of esports? Weekly Cups (June 23-29): Reynor in world title form?
Tourneys
RSL: Revival, a new crowdfunded tournament series [GSL 2025] Code S: Season 2 - Semi Finals & Finals $5,100+ SEL Season 2 Championship (SC: Evo) FEL Cracov 2025 (July 27) - $8000 live event HomeStory Cup 27 (June 27-29)
Strategy
How did i lose this ZvP, whats the proper response Simple Questions Simple Answers
Custom Maps
[UMS] Zillion Zerglings
External Content
Mutation # 480 Moths to the Flame Mutation # 479 Worn Out Welcome Mutation # 478 Instant Karma Mutation # 477 Slow and Steady
Brood War
General
Flash Announces Hiatus From ASL [ASL19] Finals Recap: Standing Tall BGH Auto Balance -> http://bghmmr.eu/ Player “Jedi” cheat on CSL Help: rep cant save
Tourneys
Small VOD Thread 2.0 [Megathread] Daily Proleagues [BSL20] GosuLeague RO16 - Tue & Wed 20:00+CET The Casual Games of the Week Thread
Strategy
Simple Questions, Simple Answers I am doing this better than progamers do.
Other Games
General Games
Stormgate/Frost Giant Megathread Nintendo Switch Thread Path of Exile What do you want from future RTS games? Beyond All Reason
Dota 2
Official 'what is Dota anymore' discussion
League of Legends
Heroes of the Storm
Simple Questions, Simple Answers Heroes of the Storm 2.0
Hearthstone
Heroes of StarCraft mini-set
TL Mafia
TL Mafia Community Thread Vanilla Mini Mafia
Community
General
US Politics Mega-thread Things Aren’t Peaceful in Palestine Russo-Ukrainian War Thread Trading/Investing Thread The Games Industry And ATVI
Fan Clubs
SKT1 Classic Fan Club! Maru Fan Club
Media & Entertainment
Anime Discussion Thread [Manga] One Piece [\m/] Heavy Metal Thread
Sports
2024 - 2025 Football Thread NBA General Discussion Formula 1 Discussion TeamLiquid Health and Fitness Initiative For 2023 NHL Playoffs 2024
World Cup 2022
Tech Support
Computer Build, Upgrade & Buying Resource Thread
TL Community
Blogs
Culture Clash in Video Games…
TrAiDoS
from making sc maps to makin…
Husyelt
Blog #2
tankgirl
StarCraft improvement
iopq
Trip to the Zoo
micronesia
Customize Sidebar...

Website Feedback

Closed Threads



Active: 665 users

The Big Programming Thread - Page 650

Forum Index > General Forum
Post a Reply
Prev 1 648 649 650 651 652 1031 Next
Thread Rules
1. This is not a "do my homework for me" thread. If you have specific questions, ask, but don't post an assignment or homework problem and expect an exact solution.
2. No recruiting for your cockamamie projects (you won't replace facebook with 3 dudes you found on the internet and $20)
3. If you can't articulate why a language is bad, don't start slinging shit about it. Just remember that nothing is worse than making CSS IE6 compatible.
4. Use [code] tags to format code blocks.
ZenithM
Profile Joined February 2011
France15952 Posts
July 17 2015 14:10 GMT
#12981
On July 17 2015 22:52 BisuDagger wrote:
Show nested quote +
On July 17 2015 22:14 Acrofales wrote:
Almost fits: 149.49 * log(x + 1). The problem is that it increases slightly too fast, and 45 isn't at 225. However, looking at your picture, you don't want 45 at 225 anyway, but slightly over 270, in which case the log increases too slow. A curve fitter should be able to fit this, though, even with so few points. I'd chug it through scipy's curve fitter for you, but I don't have time. Here's the general function:

a + b*log(c*x + d). Give it the following points: f(0) = 0, f(3) = 90, f(15) = 180, f(40) = 270.

Edit: if there is no way of scaling the log to fit these points properly, try a root:

a + b*x^(1/c)

You are correct, I had to edit my post to show 40 @ 270 degrees. I am going to check out scipy's curve fitter. Never heard of it before now.

Show nested quote +
On July 17 2015 22:16 ZenithM wrote:
AngleInDegrees = 10 * (gaugeValue * 50)^0.44 - (something)
with something being between 0 and 4, which ever looks better ;D

I'd try a root in any case.


What I have trouble wrapping my head around is a formula that tackles the whole range at once. Because between 2-5 the difference is 3, 10-15 the difference is 5, 15 to 25 the difference is 10, but then it descales 25-30 a difference of 5, and then 30-40 a difference of 10 lol. If it scaled where the difference was 1,2,3,5,5,10,10,10 that'd be a little be easier to work with.

Anyway, the code I wrote was easily cleaned up. That was written long form just for me to visual see what was happening. Now it is relatively clean and now I see I could even do better but I already committed it and moved on lol.


else if (needlePosition > 25 && needlePosition <= 30)
{
float scaleToMeter = ScaleToDegrees(25, 30, rotate25, rotate30, needlePosition);
this.transform.Rotate(Vector3.right, scaleToMeter);
}

You're right I hadn't looked at the gauge closely enough. You're probably better off hard coding it (like you did, it sounds fine) or picking another gauge picture ;D.
BisuDagger
Profile Blog Joined October 2009
Bisutopia19229 Posts
July 17 2015 14:15 GMT
#12982
On July 17 2015 23:10 ZenithM wrote:
Show nested quote +
On July 17 2015 22:52 BisuDagger wrote:
On July 17 2015 22:14 Acrofales wrote:
Almost fits: 149.49 * log(x + 1). The problem is that it increases slightly too fast, and 45 isn't at 225. However, looking at your picture, you don't want 45 at 225 anyway, but slightly over 270, in which case the log increases too slow. A curve fitter should be able to fit this, though, even with so few points. I'd chug it through scipy's curve fitter for you, but I don't have time. Here's the general function:

a + b*log(c*x + d). Give it the following points: f(0) = 0, f(3) = 90, f(15) = 180, f(40) = 270.

Edit: if there is no way of scaling the log to fit these points properly, try a root:

a + b*x^(1/c)

You are correct, I had to edit my post to show 40 @ 270 degrees. I am going to check out scipy's curve fitter. Never heard of it before now.

On July 17 2015 22:16 ZenithM wrote:
AngleInDegrees = 10 * (gaugeValue * 50)^0.44 - (something)
with something being between 0 and 4, which ever looks better ;D

I'd try a root in any case.


What I have trouble wrapping my head around is a formula that tackles the whole range at once. Because between 2-5 the difference is 3, 10-15 the difference is 5, 15 to 25 the difference is 10, but then it descales 25-30 a difference of 5, and then 30-40 a difference of 10 lol. If it scaled where the difference was 1,2,3,5,5,10,10,10 that'd be a little be easier to work with.

Anyway, the code I wrote was easily cleaned up. That was written long form just for me to visual see what was happening. Now it is relatively clean and now I see I could even do better but I already committed it and moved on lol.


else if (needlePosition > 25 && needlePosition <= 30)
{
float scaleToMeter = ScaleToDegrees(25, 30, rotate25, rotate30, needlePosition);
this.transform.Rotate(Vector3.right, scaleToMeter);
}

You're right I hadn't looked at the gauge closely enough. You're probably better off hard coding it (like you did, it sounds fine) or picking another gauge picture ;D.

I'm sure I could ask Boeing to redesign their aircraft for me. Lol.
ModeratorFormer Afreeca Starleague Caster: http://afreeca.tv/ASL2ENG2
ZenithM
Profile Joined February 2011
France15952 Posts
July 17 2015 14:24 GMT
#12983
Haha tough luck then. I hope airplane web browsers handle HTML 5 + Javascript. I wouldn't dare to ask my pilot to trust Adobe Flash gauge readings.
BisuDagger
Profile Blog Joined October 2009
Bisutopia19229 Posts
July 17 2015 14:26 GMT
#12984
On July 17 2015 23:24 ZenithM wrote:
Haha tough luck then. I hope airplane web browsers handle HTML 5 + Javascript. I wouldn't dare to ask my pilot to trust Adobe Flash gauge readings.

This is done in unity which has HTML5 support. :D
ModeratorFormer Afreeca Starleague Caster: http://afreeca.tv/ASL2ENG2
Manit0u
Profile Blog Joined August 2004
Poland17243 Posts
July 17 2015 19:22 GMT
#12985
Shouldn't it be analog in the first place?
Time is precious. Waste it wisely.
Acrofales
Profile Joined August 2010
Spain17969 Posts
July 17 2015 19:28 GMT
#12986
On July 17 2015 23:10 ZenithM wrote:
Show nested quote +
On July 17 2015 22:52 BisuDagger wrote:
On July 17 2015 22:14 Acrofales wrote:
Almost fits: 149.49 * log(x + 1). The problem is that it increases slightly too fast, and 45 isn't at 225. However, looking at your picture, you don't want 45 at 225 anyway, but slightly over 270, in which case the log increases too slow. A curve fitter should be able to fit this, though, even with so few points. I'd chug it through scipy's curve fitter for you, but I don't have time. Here's the general function:

a + b*log(c*x + d). Give it the following points: f(0) = 0, f(3) = 90, f(15) = 180, f(40) = 270.

Edit: if there is no way of scaling the log to fit these points properly, try a root:

a + b*x^(1/c)

You are correct, I had to edit my post to show 40 @ 270 degrees. I am going to check out scipy's curve fitter. Never heard of it before now.

On July 17 2015 22:16 ZenithM wrote:
AngleInDegrees = 10 * (gaugeValue * 50)^0.44 - (something)
with something being between 0 and 4, which ever looks better ;D

I'd try a root in any case.


What I have trouble wrapping my head around is a formula that tackles the whole range at once. Because between 2-5 the difference is 3, 10-15 the difference is 5, 15 to 25 the difference is 10, but then it descales 25-30 a difference of 5, and then 30-40 a difference of 10 lol. If it scaled where the difference was 1,2,3,5,5,10,10,10 that'd be a little be easier to work with.

Anyway, the code I wrote was easily cleaned up. That was written long form just for me to visual see what was happening. Now it is relatively clean and now I see I could even do better but I already committed it and moved on lol.


else if (needlePosition > 25 && needlePosition <= 30)
{
float scaleToMeter = ScaleToDegrees(25, 30, rotate25, rotate30, needlePosition);
this.transform.Rotate(Vector3.right, scaleToMeter);
}

You're right I hadn't looked at the gauge closely enough. You're probably better off hard coding it (like you did, it sounds fine) or picking another gauge picture ;D.


Yup. I also completely missed that. What weird underlying analog process led to that being a good distribution on the dial?! How do you calibrate that correctly? :O
Sufficiency
Profile Blog Joined October 2010
Canada23833 Posts
Last Edited: 2015-07-17 23:40:26
July 17 2015 23:39 GMT
#12987
Hi TL,

Sorry this isn't "exactly" programming, but I am looking for a "serious" SQL book to study from. What I mean by "serious" is that I know how to write SQL statements, but I want to understand how to write fast and efficient SQL statements and know some deeper level tricks. Basically, I am interested in becoming an expert user, but not a DBA - if that makes any sense.

As far as SQL vendor specificity is concerned, lack of specificity is preferred, but PostgreSQL or Oracle specific would be fine by me as well.

Thanks in advance.
https://twitter.com/SufficientStats
sabas123
Profile Blog Joined December 2010
Netherlands3122 Posts
July 17 2015 23:52 GMT
#12988
On July 18 2015 08:39 Sufficiency wrote:
Hi TL,

Sorry this isn't "exactly" programming, but I am looking for a "serious" SQL book to study from. What I mean by "serious" is that I know how to write SQL statements, but I want to understand how to write fast and efficient SQL statements and know some deeper level tricks. Basically, I am interested in becoming an expert user, but not a DBA - if that makes any sense.

As far as SQL vendor specificity is concerned, lack of specificity is preferred, but PostgreSQL or Oracle specific would be fine by me as well.

Thanks in advance.

I don't know any of such books, but I think your best bet would be learning how databases work?
The harder it becomes, the more you should focus on the basics.
Sufficiency
Profile Blog Joined October 2010
Canada23833 Posts
July 17 2015 23:55 GMT
#12989
On July 18 2015 08:52 sabas123 wrote:
Show nested quote +
On July 18 2015 08:39 Sufficiency wrote:
Hi TL,

Sorry this isn't "exactly" programming, but I am looking for a "serious" SQL book to study from. What I mean by "serious" is that I know how to write SQL statements, but I want to understand how to write fast and efficient SQL statements and know some deeper level tricks. Basically, I am interested in becoming an expert user, but not a DBA - if that makes any sense.

As far as SQL vendor specificity is concerned, lack of specificity is preferred, but PostgreSQL or Oracle specific would be fine by me as well.

Thanks in advance.

I don't know any of such books, but I think your best bet would be learning how databases work?


I guess that would make sense - to learn its theories. I am sure there are tons of books on this, but any recommendations?
https://twitter.com/SufficientStats
Chocolate
Profile Blog Joined December 2010
United States2350 Posts
July 18 2015 01:31 GMT
#12990
On July 18 2015 08:39 Sufficiency wrote:
Hi TL,

Sorry this isn't "exactly" programming, but I am looking for a "serious" SQL book to study from. What I mean by "serious" is that I know how to write SQL statements, but I want to understand how to write fast and efficient SQL statements and know some deeper level tricks. Basically, I am interested in becoming an expert user, but not a DBA - if that makes any sense.

As far as SQL vendor specificity is concerned, lack of specificity is preferred, but PostgreSQL or Oracle specific would be fine by me as well.

Thanks in advance.

I'm not a SQL expert by any means but in my databases course we were taught that typically SQL implementations have a built in optimizer that usually does most of that for you.
Sufficiency
Profile Blog Joined October 2010
Canada23833 Posts
Last Edited: 2015-07-18 03:34:11
July 18 2015 03:33 GMT
#12991
On July 18 2015 10:31 Chocolate wrote:
Show nested quote +
On July 18 2015 08:39 Sufficiency wrote:
Hi TL,

Sorry this isn't "exactly" programming, but I am looking for a "serious" SQL book to study from. What I mean by "serious" is that I know how to write SQL statements, but I want to understand how to write fast and efficient SQL statements and know some deeper level tricks. Basically, I am interested in becoming an expert user, but not a DBA - if that makes any sense.

As far as SQL vendor specificity is concerned, lack of specificity is preferred, but PostgreSQL or Oracle specific would be fine by me as well.

Thanks in advance.

I'm not a SQL expert by any means but in my databases course we were taught that typically SQL implementations have a built in optimizer that usually does most of that for you.


Is it really that simple though?

For example, are the following three queries the same in terms of performance?

1.

SELECT a.row_a1, b.row_b1
FROM table_a a
INNER JOIN table_b b
ON a.id = b.id and b.row_b2 = 1


2.

SELECT a.row_a1, b.row_b1
FROM table_a a
INNER JOIN (SELECT * FROM table_b where row_b2 = 1) b
ON a.id = b.id


3.

SELECT a.row_a1, b.row_b1
FROM table_a a
INNER JOIN table_b b
ON a.id = b.id and b.row_b2 = 1
WHERE b.row_b2 = 1


My impression is that 2 is better if table_b is big. I don't really know if there is a difference between 1 and 3 performance wise.
https://twitter.com/SufficientStats
Chocolate
Profile Blog Joined December 2010
United States2350 Posts
Last Edited: 2015-07-18 04:11:23
July 18 2015 04:03 GMT
#12992
Look up this thing called relational algebra. Basically my impression is that SQL implementations use relational algebra to reduce / simplify most expressions that are effectively equal, which means they end up similar or equivalent to the DB when it actually executes the queries.
wherebugsgo
Profile Blog Joined February 2010
Japan10647 Posts
Last Edited: 2015-07-18 05:01:48
July 18 2015 05:01 GMT
#12993
what do you guys do when you start a new job and want to ramp up quickly?

I've been taking notes each day in a gdoc and been trying to make a daily recap of the top 3 things I did. Been pretty useful so far but it still feels so shitty to go from being a TL on a project at a different company to knowing absolutely nothing (have to learn entirely new proprietary tech mostly) in a position where everyone tells me it'll take around 6 months to do anything useful.
phar
Profile Joined August 2011
United States1080 Posts
July 18 2015 05:35 GMT
#12994
read docs (if there are any), read code

Get someone to walk you through standing up a local system end to end. Fix some small bug(s).

Even at a place running an entirely internal stack, you should be able to make some impact in << 6 months...
Who after all is today speaking about the destruction of the Armenians?
wherebugsgo
Profile Blog Joined February 2010
Japan10647 Posts
Last Edited: 2015-07-18 05:53:57
July 18 2015 05:52 GMT
#12995
yea I don't mean make no impact within 6 months but not really pull my weight for 6 months. I've heard varying estimates from my colleagues and some friends who work/have worked here and the consensus seems to be 3-6 months ramp up time to at least not feel like you're just treading water the whole time.

At my previous work it was about a month for me but this is definitely a different beast. Everyone here is way smarter than I am lol

also I'm in a slightly different role, not really SWE. My team is like half SWE half SRE across three different continents...it's actually pretty surreal
r3dox
Profile Blog Joined May 2003
Germany261 Posts
July 18 2015 08:08 GMT
#12996
On July 18 2015 14:01 wherebugsgo wrote:
what do you guys do when you start a new job and want to ramp up quickly?.


ask devs to look over their shoulder / do pair programming on "Routine" Tasks in the code base / System. And let them explain most of their steps how/why they do it etc. ask questions while they do it

Do code Review on small Features / bug fixes and understand why that requirement needed to touch all the places it did.
If there are Overall architecture / design Meetings / discussions listen in from time to time.
teamamerica
Profile Blog Joined July 2010
United States958 Posts
Last Edited: 2015-07-18 08:35:49
July 18 2015 08:21 GMT
#12997
On July 18 2015 12:33 Sufficiency wrote:
Show nested quote +
On July 18 2015 10:31 Chocolate wrote:
On July 18 2015 08:39 Sufficiency wrote:
Hi TL,

Sorry this isn't "exactly" programming, but I am looking for a "serious" SQL book to study from. What I mean by "serious" is that I know how to write SQL statements, but I want to understand how to write fast and efficient SQL statements and know some deeper level tricks. Basically, I am interested in becoming an expert user, but not a DBA - if that makes any sense.

As far as SQL vendor specificity is concerned, lack of specificity is preferred, but PostgreSQL or Oracle specific would be fine by me as well.

Thanks in advance.

I'm not a SQL expert by any means but in my databases course we were taught that typically SQL implementations have a built in optimizer that usually does most of that for you.


Is it really that simple though?

For example, are the following three queries the same in terms of performance?

1.

SELECT a.row_a1, b.row_b1
FROM table_a a
INNER JOIN table_b b
ON a.id = b.id and b.row_b2 = 1


2.

SELECT a.row_a1, b.row_b1
FROM table_a a
INNER JOIN (SELECT * FROM table_b where row_b2 = 1) b
ON a.id = b.id


3.

SELECT a.row_a1, b.row_b1
FROM table_a a
INNER JOIN table_b b
ON a.id = b.id and b.row_b2 = 1
WHERE b.row_b2 = 1


My impression is that 2 is better if table_b is big. I don't really know if there is a difference between 1 and 3 performance wise.


On July 18 2015 12:33 Sufficiency wrote:
Show nested quote +
On July 18 2015 10:31 Chocolate wrote:
On July 18 2015 08:39 Sufficiency wrote:
Hi TL,

Sorry this isn't "exactly" programming, but I am looking for a "serious" SQL book to study from. What I mean by "serious" is that I know how to write SQL statements, but I want to understand how to write fast and efficient SQL statements and know some deeper level tricks. Basically, I am interested in becoming an expert user, but not a DBA - if that makes any sense.

As far as SQL vendor specificity is concerned, lack of specificity is preferred, but PostgreSQL or Oracle specific would be fine by me as well.

Thanks in advance.

I'm not a SQL expert by any means but in my databases course we were taught that typically SQL implementations have a built in optimizer that usually does most of that for you.


Is it really that simple though?

For example, are the following three queries the same in terms of performance?

1.

SELECT a.row_a1, b.row_b1
FROM table_a a
INNER JOIN table_b b
ON a.id = b.id and b.row_b2 = 1


2.

SELECT a.row_a1, b.row_b1
FROM table_a a
INNER JOIN (SELECT * FROM table_b where row_b2 = 1) b
ON a.id = b.id


3.

SELECT a.row_a1, b.row_b1
FROM table_a a
INNER JOIN table_b b
ON a.id = b.id and b.row_b2 = 1
WHERE b.row_b2 = 1


My impression is that 2 is better if table_b is big. I don't really know if there is a difference between 1 and 3 performance wise.


I can't imagine a case where query optimizer doesn't put 1st and 3rd to same. I get same query plan for both over a few different combinations I tried.

Without knowing more of your schema it's really impossible to say which would be faster though (1st/3rd or 2nd). It's a function of indices on your table, the size of the tables, the last time you might have run gather stats or analyze on your table -- all these factors go into what to query plan optimizer decides to execute.

For example, if I have an index on table b, column b.id, b.row_2 then for me, 1st,3rd query blows 2nd query out of water in my testing. Because in that case, MySQL is able to use that index, but with the subquery it's not smart enough. But that's in my case. I really can't say for sure what it might decide to do as table grows much larger. I'm not DBA at work but I know they running into issues with query plans changing as table size grows (but that's Oracle).

The MySQL refpages have probably been on of the most useful things for me, If you really want to become an expert, you should read the refpages for your specific database, since as you can see, queries that reduce to the same result set can be executed differently and that result really comes down to the DB you're using to get the most out of it.

Here's a transcipt of me talking to my database trying a few queries, but in general this is useless to anyone not me since your database will have different indices, table size, and useage patterns.

Sorry I don't have any exact advice, just thought I'd throw in my 2cents.

edit: some practical links:
http://patshaughnessy.net/2014/11/11/discovering-the-computer-science-behind-postgres-indexes
http://use-the-index-luke.com/

+ Show Spoiler +

ysql> SELECT COUNT(*) FROM replays_buid;
ERROR 1146 (42S02): Table 'app.replays_buid' doesn't exist
mysql> SELECT COUNT(*) FROM replays_buildevent;
+----------+
| COUNT(*) |
+----------+
| 7193800 |
+----------+
1 row in set (5.09 sec)

mysql> SELECT COUNT(*) FROM replays_build;
+----------+
| COUNT(*) |
+----------+
| 26507 |
+----------+
1 row in set (0.02 sec)

mysql> SELECT COUNT(b.id)
-> FROM replays_build b
-> INNER JOIN (SELECT * FROM replays_buildevent be WHERE be.name = "SCV") be ON b.id = be.build_id;
+-------------+
| COUNT(b.id) |
+-------------+
| 457551 |
+-------------+
1 row in set (28.22 sec)

mysql> SELECT COUNT(b.id)
-> FROM replays_build b
-> JOIN replays_buildevent be ON b.id = be.build_id
-> WHERE be.name = "SCV";
+-------------+
| COUNT(b.id) |
+-------------+
| 457551 |
+-------------+
1 row in set (0.99 sec)

mysql> SELECT COUNT(*)
-> FROM replays_build b
-> INNER JOIN (SELECT * FROM replays_buildevent be WHERE be.name = "SCV") be ON b.match_id = be.time;
+----------+
| COUNT(*) |
+----------+
| 910866 |
+----------+
1 row in set (38.02 sec)

mysql> SELECT COUNT(b.id)
-> FROM replays_build b
-> JOIN replays_buildevent be ON b.match_id = be.time
-> WHERE be.name = "SCV";
+-------------+
| COUNT(b.id) |
+-------------+
| 910866 |
+-------------+
1 row in set (18.82 sec)

mysql> EXPLAIN EXTENDED
-> SELECT COUNT(b.id)
-> FROM replays_build b
-> JOIN replays_buildevent be ON b.match_id = be.time
-> WHERE be.name = "SCV";
+----+-------------+-------+------+------------------------+------------------------+---------+-------------+---------+----------+-------------+
| id | select_type | table | type | possible_keys | key | key_len | ref | rows | filtered | Extra |
+----+-------------+-------+------+------------------------+------------------------+---------+-------------+---------+----------+-------------+
| 1 | SIMPLE | be | ALL | NULL | NULL | NULL | NULL | 6227388 | 100.00 | Using where |
| 1 | SIMPLE | b | ref | replays_build_ff9c4e4a | replays_build_ff9c4e4a | 4 | app.be.time | 1 | 100.00 | Using index |
+----+-------------+-------+------+------------------------+------------------------+---------+-------------+---------+----------+-------------+
2 rows in set, 1 warning (0.00 sec)

mysql> EXPLAIN EXTENDED
-> SELECT COUNT(*)
-> FROM replays_build b
-> INNER JOIN (SELECT * FROM replays_buildevent be WHERE be.name = "SCV") be ON b.match_id = be.time;
+----+-------------+------------+-------+------------------------+------------------------+---------+----------------+---------+----------+-------------+
| id | select_type | table | type | possible_keys | key | key_len | ref | rows | filtered | Extra |
+----+-------------+------------+-------+------------------------+------------------------+---------+----------------+---------+----------+-------------+
| 1 | PRIMARY | b | index | replays_build_ff9c4e4a | replays_build_ff9c4e4a | 4 | NULL | 24545 | 100.00 | Using index |
| 1 | PRIMARY | <derived2> | ref | <auto_key0> | <auto_key0> | 4 | app.b.match_id | 253 | 100.00 | NULL |
| 2 | DERIVED | be | ALL | NULL | NULL | NULL | NULL | 6227388 | 100.00 | Using where |
+----+-------------+------------+-------+------------------------+------------------------+---------+----------------+---------+----------+-------------+
3 rows in set, 1 warning (0.00 sec)

mysql> EXPLAIN EXTENDED
-> SELECT COUNT(b.id)
-> FROM replays_build b
-> JOIN replays_buildevent be ON b.id = be.build_id
-> WHERE be.name = "SCV";
+----+-------------+-------+-------+---------------+------------------------+---------+----------------+-------+----------+--------------------------+
| id | select_type | table | type | possible_keys | key | key_len | ref | rows | filtered | Extra |
+----+-------------+-------+-------+---------------+------------------------+---------+----------------+-------+----------+--------------------------+
| 1 | SIMPLE | b | index | PRIMARY | replays_build_ff9c4e4a | 4 | NULL | 24545 | 100.00 | Using index |
| 1 | SIMPLE | be | ref | build_name | build_name | 771 | app.b.id,const | 5 | 100.00 | Using where; Using index |
+----+-------------+-------+-------+---------------+------------------------+---------+----------------+-------+----------+--------------------------+
2 rows in set, 1 warning (0.00 sec)

mysql> SELECT COUNT(b.id)
-> FROM replays_build b
-> INNER JOIN (SELECT * FROM replays_buildevent be WHERE be.name = "SCV") be ON b.id = be.build_id;
+-------------+
| COUNT(b.id) |
+-------------+
| 457551 |
+-------------+
1 row in set (27.81 sec)

mysql> EXPLAIN EXTENDED
-> SELECT COUNT(b.id)
-> FROM replays_build b
-> INNER JOIN (SELECT * FROM replays_buildevent be WHERE be.name = "SCV") be ON b.id = be.build_id;
+----+-------------+------------+-------+---------------+------------------------+---------+----------+---------+----------+-------------+
| id | select_type | table | type | possible_keys | key | key_len | ref | rows | filtered | Extra |
+----+-------------+------------+-------+---------------+------------------------+---------+----------+---------+----------+-------------+
| 1 | PRIMARY | b | index | PRIMARY | replays_build_ff9c4e4a | 4 | NULL | 24545 | 100.00 | Using index |
| 1 | PRIMARY | <derived2> | ref | <auto_key0> | <auto_key0> | 4 | app.b.id | 253 | 100.00 | NULL |
| 2 | DERIVED | be | ALL | NULL | NULL | NULL | NULL | 6227388 | 100.00 | Using where |
+----+-------------+------------+-------+---------------+------------------------+---------+----------+---------+----------+-------------+
3 rows in set, 1 warning (0.00 sec)
RIP GOMTV. RIP PROLEAGUE.
Manit0u
Profile Blog Joined August 2004
Poland17243 Posts
Last Edited: 2015-07-18 08:42:44
July 18 2015 08:32 GMT
#12998
On July 18 2015 12:33 Sufficiency wrote:
Show nested quote +
On July 18 2015 10:31 Chocolate wrote:
On July 18 2015 08:39 Sufficiency wrote:
Hi TL,

Sorry this isn't "exactly" programming, but I am looking for a "serious" SQL book to study from. What I mean by "serious" is that I know how to write SQL statements, but I want to understand how to write fast and efficient SQL statements and know some deeper level tricks. Basically, I am interested in becoming an expert user, but not a DBA - if that makes any sense.

As far as SQL vendor specificity is concerned, lack of specificity is preferred, but PostgreSQL or Oracle specific would be fine by me as well.

Thanks in advance.

I'm not a SQL expert by any means but in my databases course we were taught that typically SQL implementations have a built in optimizer that usually does most of that for you.


Is it really that simple though?

For example, are the following three queries the same in terms of performance?

1.

SELECT a.row_a1, b.row_b1
FROM table_a a
INNER JOIN table_b b
ON a.id = b.id and b.row_b2 = 1


2.

SELECT a.row_a1, b.row_b1
FROM table_a a
INNER JOIN (SELECT * FROM table_b where row_b2 = 1) b
ON a.id = b.id


3.

SELECT a.row_a1, b.row_b1
FROM table_a a
INNER JOIN table_b b
ON a.id = b.id and b.row_b2 = 1
WHERE b.row_b2 = 1


My impression is that 2 is better if table_b is big. I don't really know if there is a difference between 1 and 3 performance wise.


It also depends on what kind of data you want from the DB. You could look up some database abstraction stuff and see how they do things (Doctrine is open source, you could definitely check out their hydration modes). It's fairly important to not only optimize your queries, it's just as important to reduce the number of queries and to get back only the stuff you need, without superfluous things.

Some most useful stuff includes COUNT, CONCAT, HAVING and GROUP BY.

Too many times I've seen code execute the query only to do stupid stuff like that:


$query = $queryBuilder
->select('o') // that's equal to *
->from('myTable')
->where('statement)
->getQuery();

$result = $query->getResult();

return count($result);


What it should be:


$query = $queryBuilder
->select('COUNT(o.id)')
->from('myTable')
->where('statement)
->getQuery();

$result = $query->getSingleScalarResult();

return $result;


CONCAT is likewise useful, when you want to display the user's first name + last name for example. Instead of doing concatenation later in the code you can simply select "CONCAT('u.first_name', ' ', 'u.last_name') AS name" and work with that.

You also don't always need objects and should use stuff like getArrayResult() (still speaking about Doctrine since I can't really live without some form of DBAL any more).

Another really important thing is query parametrization. So that you can reuse your queries for different data.


SELECT * FROM Orders WHERE CustomerID =?



INSERT INTO Employees(LastName, FirstName, Title, TitleOfCourtesy,
BirthDate, HireDate, Address, City, Region, PostalCode, Country,
HomePhone, Extension, Photo, Notes, ReportsTo, PhotoPath, rowguid)
VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)


As a bonus, I present you with this most interesting study regarding DB performance when storing dates and times (tldr: never use timestamps in your db).
Time is precious. Waste it wisely.
phar
Profile Joined August 2011
United States1080 Posts
Last Edited: 2015-07-18 19:45:17
July 18 2015 19:41 GMT
#12999
On July 18 2015 14:52 wherebugsgo wrote:
yea I don't mean make no impact within 6 months but not really pull my weight for 6 months. I've heard varying estimates from my colleagues and some friends who work/have worked here and the consensus seems to be 3-6 months ramp up time to at least not feel like you're just treading water the whole time.

At my previous work it was about a month for me but this is definitely a different beast. Everyone here is way smarter than I am lol

also I'm in a slightly different role, not really SWE. My team is like half SWE half SRE across three different continents...it's actually pretty surreal

Send me a PM, if you're working where I think you're working. There are likely resources internally that can help you out.


Also it is normal (nay, required) for SRE teams to be split across continents, here is the logic:

1) SRE oncall is real (hard core) on call, with proper SLO/SLA for all systems, and for answering pages. That means in normal dev land, if a SWE is on call and a page happens, and they don't answer for 15 minutes maybe it's ok. Oftentimes (depending on the level of requirement) an SRE is acking that shit in like a minute. That means you can't even go take a shit or drive home without clearing it with secondary.

2) You want your SRE to be awake and able to actually triage & solve production issues ASAP when answering a page. (For example an on-call dev waking up at 3 am is not going to actually solve any problem for like 30 minutes, because 3am you're groggy).

-> The solution here is time zone rotations. Some SRE teams will be split across 2 timezones (west coast & Europe is common) later in the evening. West coast on call during daylight hours there, then swap to Europe in the evening. Rinse & repeat. More expansive SRE teams will be split across 3 timezones (usually Australia or the like), only 8 hour shifts.



All that does make it hard to coordinate, because remote teammates can be harder to work with. Requires a lot of proactive communication. Also helps if you get to fly around and meet up with everyone, see what everybody's like in person. You'll realize that for the most part people do have your back, and are interested in helping you succeed - while remotely over email/code reviews/im, people can seem a bit more terse & not as helpful.
Who after all is today speaking about the destruction of the Armenians?
Manit0u
Profile Blog Joined August 2004
Poland17243 Posts
Last Edited: 2015-07-18 22:10:45
July 18 2015 22:06 GMT
#13000
Damn guys, you're using all those acronyms... Could you at least explain what they mean? Google returns way too many possibilities and I'm genuinely curious here.

Random rant continued: Client presentation due the day after tomorrow, had to pull another saturday workday until 7pm, ux designer, half of the devs and all front-end people are on vacation, app looks like shit because every back-end dev was like "functionality is working, I'll just dump all the results wherever to prove it, let the front-end handle it" (I'm part of back-end too, but I had some experience with front-end so I at least made my stuff a bit more managable). My heart says it's fine, my brain says otherwise. Especially that (unlike most clients), this one sent a guy who was developing business apps for a living for years to act as their guy (the very first question he asked was "What's your test coverage?").

I really do feel rather grimdark right now.
Time is precious. Waste it wisely.
Prev 1 648 649 650 651 652 1031 Next
Please log in or register to reply.
Live Events Refresh
Next event in 3h 40m
[ Submit Event ]
Live Streams
Refresh
StarCraft 2
mouzHeroMarine 596
JuggernautJason94
StarCraft: Brood War
Britney 14479
Dewaltoss 192
Aegong 45
GoRush 13
IntoTheRainbow 7
yabsab 5
Dota 2
Gorgc7367
League of Legends
Dendi1481
JimRising 443
Counter-Strike
fl0m1928
flusha408
Foxcn365
sgares185
Super Smash Bros
Mew2King179
Heroes of the Storm
Liquid`Hasu605
Other Games
summit1g6033
FrodaN2371
tarik_tv1112
elazer248
RotterdaM161
Pyrionflax116
ViBE84
Trikslyr64
Sick62
PPMD12
Liquid`Ken5
Organizations
Other Games
BasetradeTV30
StarCraft 2
Blizzard YouTube
StarCraft: Brood War
BSLTrovo
sctven
[ Show 18 non-featured ]
StarCraft 2
• LUISG 10
• intothetv
• IndyKCrew
• sooper7s
• Migwel
• AfreecaTV YouTube
• LaughNgamezSOOP
• Kozan
StarCraft: Brood War
• blackmanpl 38
• 80smullet 29
• STPLYoutube
• ZZZeroYoutube
• BSLYoutube
League of Legends
• Doublelift2783
• Jankos2203
• masondota2502
Other Games
• imaqtpie873
• Shiphtur187
Upcoming Events
Replay Cast
3h 40m
RSL Revival
13h 40m
herO vs SHIN
Reynor vs Cure
OSC
16h 40m
WardiTV European League
19h 40m
Scarlett vs Percival
Jumy vs ArT
YoungYakov vs Shameless
uThermal vs Fjant
Nicoract vs goblin
Harstem vs Gerald
FEL
19h 40m
Korean StarCraft League
1d 6h
CranKy Ducklings
1d 13h
RSL Revival
1d 13h
FEL
1d 19h
Sparkling Tuna Cup
2 days
[ Show More ]
RSL Revival
2 days
FEL
2 days
BSL: ProLeague
2 days
Dewalt vs Bonyth
Replay Cast
4 days
Replay Cast
4 days
The PondCast
5 days
Replay Cast
6 days
RSL Revival
6 days
Liquipedia Results

Completed

Proleague 2025-06-28
HSC XXVII
Heroes 10 EU

Ongoing

JPL Season 2
BSL 2v2 Season 3
BSL Season 20
Acropolis #3
KCM Race Survival 2025 Season 2
CSL 17: 2025 SUMMER
Copa Latinoamericana 4
Championship of Russia 2025
RSL Revival: Season 1
Murky Cup #2
BLAST.tv Austin Major 2025
ESL Impact League Season 7
IEM Dallas 2025
PGL Astana 2025
Asian Champions League '25
BLAST Rivals Spring 2025
MESA Nomadic Masters
CCT Season 2 Global Finals
IEM Melbourne 2025
YaLLa Compass Qatar 2025

Upcoming

CSLPRO Last Chance 2025
CSLPRO Chat StarLAN 3
K-Championship
uThermal 2v2 Main Event
SEL Season 2 Championship
FEL Cracov 2025
Esports World Cup 2025
StarSeries Fall 2025
FISSURE Playground #2
BLAST Open Fall 2025
BLAST Open Fall Qual
Esports World Cup 2025
BLAST Bounty Fall 2025
BLAST Bounty Fall Qual
IEM Cologne 2025
FISSURE Playground #1
TLPD

1. ByuN
2. TY
3. Dark
4. Solar
5. Stats
6. Nerchio
7. sOs
8. soO
9. INnoVation
10. Elazer
1. Rain
2. Flash
3. EffOrt
4. Last
5. Bisu
6. Soulkey
7. Mini
8. Sharp
Sidebar Settings...

Advertising | Privacy Policy | Terms Of Use | Contact Us

Original banner artwork: Jim Warren
The contents of this webpage are copyright © 2025 TLnet. All Rights Reserved.