• Log InLog In
  • Register
Liquid`
Team Liquid Liquipedia
EST 05:52
CET 11:52
KST 19:52
  • Home
  • Forum
  • Calendar
  • Streams
  • Liquipedia
  • Features
  • Store
  • EPT
  • TL+
  • StarCraft 2
  • Brood War
  • Smash
  • Heroes
  • Counter-Strike
  • Overwatch
  • Liquibet
  • Fantasy StarCraft
  • TLPD
  • StarCraft 2
  • Brood War
  • Blogs
Forum Sidebar
Events/Features
News
Featured News
ByuL: The Forgotten Master of ZvT28Behind the Blue - Team Liquid History Book19Clem wins HomeStory Cup 289HomeStory Cup 28 - Info & Preview13Rongyi Cup S3 - Preview & Info8
Community News
Weekly Cups (Feb 16-22): MaxPax doubles0Weekly Cups (Feb 9-15): herO doubles up2ACS replaced by "ASL Season Open" - Starts 21/0255LiuLi Cup: 2025 Grand Finals (Feb 10-16)46Weekly Cups (Feb 2-8): Classic, Solar, MaxPax win2
StarCraft 2
General
How do you think the 5.0.15 balance patch (Oct 2025) for StarCraft II has affected the game? Terran AddOns placement Nexon's StarCraft game could be FPS, led by UMS maker ByuL: The Forgotten Master of ZvT Oliveira Would Have Returned If EWC Continued
Tourneys
PIG STY FESTIVAL 7.0! (19 Feb - 1 Mar) SEL Doubles (SC Evo Bimonthly) WardiTV Team League Season 10 RSL Season 4 announced for March-April The Dave Testa Open #11
Strategy
Custom Maps
Publishing has been re-enabled! [Feb 24th 2026] Map Editor closed ?
External Content
Mutation # 514 Ulnar New Year The PondCast: SC2 News & Results Mutation # 513 Attrition Warfare Mutation # 512 Overclocked
Brood War
General
Soma Explains: JD's Unrelenting Aggro vs FlaSh ACS replaced by "ASL Season Open" - Starts 21/02 BGH Auto Balance -> http://bghmmr.eu/ TvZ is the most complete match up BW General Discussion
Tourneys
[LIVE] [S:21] ASL Season Open Day 1 ASL Season 21 Qualifiers March 7-8 [Megathread] Daily Proleagues Small VOD Thread 2.0
Strategy
Soma's 9 hatch build from ASL Game 2 Fighting Spirit mining rates Simple Questions, Simple Answers Zealot bombing is no longer popular?
Other Games
General Games
Nintendo Switch Thread Battle Aces/David Kim RTS Megathread Path of Exile Beyond All Reason New broswer game : STG-World
Dota 2
Official 'what is Dota anymore' discussion
League of Legends
Heroes of the Storm
Simple Questions, Simple Answers Heroes of the Storm 2.0
Hearthstone
Deck construction bug Heroes of StarCraft mini-set
TL Mafia
Vanilla Mini Mafia Mafia Game Mode Feedback/Ideas TL Mafia Community Thread
Community
General
US Politics Mega-thread Things Aren’t Peaceful in Palestine UK Politics Mega-thread YouTube Thread Mexico's Drug War
Fan Clubs
The IdrA Fan Club The herO Fan Club!
Media & Entertainment
[Manga] One Piece [Req][Books] Good Fantasy/SciFi books Anime Discussion Thread
Sports
2024 - 2026 Football Thread Formula 1 Discussion TL MMA Pick'em Pool 2013
World Cup 2022
Tech Support
Laptop capable of using Photoshop Lightroom?
TL Community
The Automated Ban List
Blogs
YOUTUBE VIDEO
XenOsky
Unintentional protectionism…
Uldridge
ASL S21 English Commentary…
namkraft
Inside the Communication of …
TrAiDoS
My 2025 Magic: The Gathering…
DARKING
Customize Sidebar...

Website Feedback

Closed Threads



Active: 2475 users

Quick Linear Algebra Question- Not homework

Blogs > Chocolate
Post a Reply
Chocolate
Profile Blog Joined December 2010
United States2350 Posts
Last Edited: 2013-05-15 23:21:04
May 15 2013 22:15 GMT
#1
So, my math was teacher talking recently with me and a few other of the math students at my high school who do math competitions. We were complaining that our school doesn't teach any math beyond Calc BC, while many other schools have at least MVC. He said if our school were to ever have a more advanced class, it would be linear algebra. I looked in to linear algebra, since he said it was pretty easy, and found this book online: the book's page. Be warned, the pdf is quite large (465pages).

I've covered the first chapter (wimpy, I know) but I already have a few questions. Since I don't want to tell my math teacher that I'm studying this yet while I'm only done with the first (pretty basic) chapter, I was hoping that maybe I could put some questions on this blog when I have them.

First question: Is Gauss' method really that important? It seems like these systems of equations could be often solved much faster using simple matrix division, not to mention the ability to simply plug matrices into my calculator. I know that systems with non-specific solutions will still require some manipulation by hand, and that these solutions are probably pretty important since from what I can tell they could yield planes and other shapes in 3rd to xth dimensional spaces, but would these even require Gauss' method? It seems like substitution would be very useful in simplifying some systems, and from what I can tell Gauss' method really only uses elimination.

Second Question: Will I need to know any calculus beyond simple derivatives and integrals? The book description says no, but if I were to take a typical, more challenging linear algebra course at a well regarded university, would I need to know something more? It seems that it could at least be important to take the integral of some shapes to find volumes.

Third and final question: Will most universities let me test out of this course in some way? Since I'm interested in mathematics and will likely be going into a STEM field, I want to go in to uni with Calc, MVC, DiffE, and Linear Algebra out of the way to take more theoretical and difficult courses (I guess I would start with Discrete Math?). As much as it could boost my GPA, I don't want to take these math classes over again.

Thanks for your time and if you think the textbook is trash or have a recommendation I'm all ears.

Oh yeah, forgot to mention that I'm also motivated by a desire to do well in the Putnam competition in uni. I'm preparing for it by taking the above courses as well as, at first, working through AMC, AIME, and USAMO problems. If I'm missing a crucial course (I was thinking possibly set theory?) I'd really like to know.

hypercube
Profile Joined April 2010
Hungary2735 Posts
Last Edited: 2013-05-15 22:41:36
May 15 2013 22:41 GMT
#2
You should know how to calculate 154 times 74 on paper even if you always do it using a calculator. Same goes for Gauss's method. There's no point in drilling it for speed or anything like that but you should understand how it works. It's not that hard either, it's exactly the same as solving a system of linear equations by eliminating variables. Except you don't write down the name of variable and insert 0s as needed.

I'm guessing by matrix division you mean multiplying by the inverse. For most larger matrices you do calculate inverses by Gaussian elimination

You don't need any calculus to learn linear algebra. Maybe the book includes a lot of examples from calculus or something. OTOH, multivariable calculus and differential equations do use ideas from linear algebra.

Can't comment on the other questions though.
"Sending people in rockets to other planets is a waste of money better spent on sending rockets into people on this planet."
Chocolate
Profile Blog Joined December 2010
United States2350 Posts
May 15 2013 22:51 GMT
#3
By matrix division I do mean multiplying by the inverse, but I don't mean writing down a matrix and solving it by hand. I'd rather just use Gauss's method. I have a graphing calculator with matrix capabilities so I can just define a matrix A that is x by x , a matrix B that is x by 1 , and multiply the inverse of A by B to get a specific solution very quickly. To me this seems much faster than doing a whole bunch of elimination, putting things in echelon form, and then continually substituting values for variables.

I'm not bad at arithmetic. Hell, I am heavily involved in academic competitions in which I have to do a lot of arithmetic pretty quickly. I don't, however, want to do a lot of arithmetic that will only slow me down.

Thank you for your help! I'm glad I won't have to learn any more calculus.
Muirhead
Profile Blog Joined October 2007
United States556 Posts
May 15 2013 23:35 GMT
#4
When I learned linear algebra in high school I learned from two sources:
First, I looked through Gilbert Strang's MIT OCW videos (look them up) and solved some of MIT's homework problem. Then I read Serge Lang's linear algebra book and did all the proofs from it. I highly recommend Lang's book if you are familiar with proofs from USAMO work. Some of my friends also like the book "Linear Algebra Done Right" by Axler.

There are two ways to learn linear algebra: the engineering way which is full of matrices and the mathematics way which introduces the concept of a vector space and hardly touches explicit matrices.

Regarding skipping linear algebra, any of the better schools will let you skip any math course you want to skip. They may not recommend it, but if you want to walk into algebraic geometry on the first day they will let you. The phrase for this is "enough noose to hang yourself."
starleague.mit.edu
radscorpion9
Profile Blog Joined March 2011
Canada2252 Posts
Last Edited: 2013-05-16 00:35:02
May 16 2013 00:24 GMT
#5
But how would you get the inverse? If your graphing calculator is doing it for you then that explains why its so easy; but otherwise you would need to get matrix A into identity matrix form while performing the same operations to transform an associated identity matrix into the inverse, which is basically the same as echelon row reduction. All of this is covered much, much later in your book, but it looks like you already know!

So either way you would have to go through that echelon row reduction, but the only difference is that with your method there is an extra step of multiplying (A inverse) with B

Also only some matrices have inverses - they have to be square (n x n) and have linearly independent rows/columns, so your method won't always yield a specific solution if you're working with an m x n matrix (where m does not equal n).

Just to be clear there shouldn't be any substitution required except for the trivial observation of what the results are, which you can read off of the reduced matrix. You should be only reducing one matrix, and the answers will be apparent at the end of that reduction without any substitution required.

As far as I'm aware, from my linear algebra course you can only get parametric (infinite) solutions using row reduction, although there may be more advanced ways taught in higher level courses. But I'm pretty sure they move on from linear algebra to non-linear cases. Gaussian elimination is simply a fast way to determine whether equations are linearly independent or dependent, while also providing you with any possible solutions to those equations.

And in my course (which was the more advanced version) we only required basic calculus and differentiation when we were dealing with maps from one vector space to another, which you will learn later. Basically you just integrate/differentiate simple polynomials.

I hope I didn't forget anything crucial or made any errors! I'm in Canada so I don't know the answer to your last question. It was an important prerequisite in my university (Toronto) for more advanced math courses, but I think you could get a transfer credit allowing you to skip that course. There is quite a lot you need to learn in advanced linear algebra beyond elementary matrix multiplication or row reduction. It gets complicated when they start talking about maps, isomorphisms...or maybe I fell behind . Either way if you're considering putnam, I'm sure you'll find it quite nice and easy.
ymir233
Profile Blog Joined June 2010
United States8275 Posts
May 16 2013 02:19 GMT
#6
On May 16 2013 07:15 Chocolate wrote:
So, my math was teacher talking recently with me and a few other of the math students at my high school who do math competitions. We were complaining that our school doesn't teach any math beyond Calc BC, while many other schools have at least MVC. He said if our school were to ever have a more advanced class, it would be linear algebra. I looked in to linear algebra, since he said it was pretty easy, and found this book online: the book's page. Be warned, the pdf is quite large (465pages).

I've covered the first chapter (wimpy, I know) but I already have a few questions. Since I don't want to tell my math teacher that I'm studying this yet while I'm only done with the first (pretty basic) chapter, I was hoping that maybe I could put some questions on this blog when I have them.

First question: Is Gauss' method really that important? It seems like these systems of equations could be often solved much faster using simple matrix division, not to mention the ability to simply plug matrices into my calculator. I know that systems with non-specific solutions will still require some manipulation by hand, and that these solutions are probably pretty important since from what I can tell they could yield planes and other shapes in 3rd to xth dimensional spaces, but would these even require Gauss' method? It seems like substitution would be very useful in simplifying some systems, and from what I can tell Gauss' method really only uses elimination.

Second Question: Will I need to know any calculus beyond simple derivatives and integrals? The book description says no, but if I were to take a typical, more challenging linear algebra course at a well regarded university, would I need to know something more? It seems that it could at least be important to take the integral of some shapes to find volumes.

Third and final question: Will most universities let me test out of this course in some way? Since I'm interested in mathematics and will likely be going into a STEM field, I want to go in to uni with Calc, MVC, DiffE, and Linear Algebra out of the way to take more theoretical and difficult courses (I guess I would start with Discrete Math?). As much as it could boost my GPA, I don't want to take these math classes over again.

Thanks for your time and if you think the textbook is trash or have a recommendation I'm all ears.

Oh yeah, forgot to mention that I'm also motivated by a desire to do well in the Putnam competition in uni. I'm preparing for it by taking the above courses as well as, at first, working through AMC, AIME, and USAMO problems. If I'm missing a crucial course (I was thinking possibly set theory?) I'd really like to know.


Gaussian elimination is important in the sense that addition is important. It sets up the basics for later manipulations. You think you can just plug and chug everything (esp. in numerical computing)? No way. Inverse/substitution is naively decent, but carefully planned Gaussian elimination is much more efficient and less-error prone. Also, you can't do determinant manipulation if you don't know how/why Gaussian elim works.

You won't need much. The derivatives and integrals will be useful for infinite series stuff with matrices/exponential decomposition later.

Most universities shouldn't let you test out, since linalg is just so important in everything mathematics related at the higher level. Talk with your dept head if you really want to do something about it, but you better have the chops (as in, more than just being able to do formula shits like singular value decomposition or Gram-Schmidt...proofs are key).

Strang is decent, has a few errors. Lay is the standard HS book. Axler is nice, more abstract/less computational than a lot. It's one of the few books that doesn't barrel towards Gram-Schmidt as a conclusion.

If you're concerned about Putnam as a high priority, forget about learning linalg straight off the book. Just keep solving random linalg problems while struggling like a mofo looking through AoPS links...basic linear algebra (ESPECIALLY properties of trace/determinant/symmetric/triangular matrices) should be able to get you through 99% of Putnam problems. Although I'm kinda worried about your prospect at Putnam if you're just now getting into AMC/AIME/USAMO....
Come motivate me to be cynical about animus at http://infinityandone.blogspot.com/ // Stork proxy gates are beautiful.
n.DieJokes
Profile Blog Joined November 2008
United States3443 Posts
Last Edited: 2013-05-16 06:10:20
May 16 2013 06:02 GMT
#7
Gauss's Method is Gaussian Elimination right? GE gives you an algorithm to determine the rank of the matrix (which isn't obvious by inspection in most matrices). In regular algebra you'd ask questions like, 2x=3 solve for x and you'd say x=3/2. Now in linear algebra I can ask you Ax=b, does x exist? If x exists, is it the unique solution? If it's not the unique solution, what does the space of solutions look like? What are the possible values of x? The rank gives you an answer to (some) these questions and you find the rank using GE. I mean, it also gives you an easy way to solve Ax=b by inspection but that's not the point.

This is the point, GE illustrates in some the sense the main idea that makes linear algebra work. We can manipulate a matrix into certain forms without altering the fundamental properties of the matrix and in these nice forms we can extract a bunch of information that makes solving the system easy (this is maximally vague lol).

2) Nope, no calculus necessary (although there is interplay of the two and some really nice applications but this is true for linear algebra and just about every branch of mathematics)

3) Usually you take diff eq and multi at a CC and they count that credit. If you just self study, they aren't going to let you skip all these classes based on just your word, you'll have to prove yourself in a course or two first. This isn't a bad thing; in fact, you'll probably gain a lot by taking them even if you're already familiar with the concepts. Self study can make you proficient in vocabulary and problem solving but, especially since you're just starting out with math, its very easy to miss the big picture. The why this stuff matters more than that stuff even though they're both in the chapter. How this material is a generalization of past material and etc. A teacher doesn't just know the material, they know how it all fits together
MyLove + Your Love= Supa Love
jalstar
Profile Blog Joined September 2009
United States8198 Posts
May 16 2013 07:01 GMT
#8
Write a linear algebra calculator in C++ or Java or something, you'll quickly see why you'd rather do Gaussian elimination than take the inverse.
corpuscle
Profile Blog Joined April 2011
United States1967 Posts
May 16 2013 15:35 GMT
#9
On May 16 2013 16:01 jalstar wrote:
Write a linear algebra calculator in C++ or Java or something, you'll quickly see why you'd rather do Gaussian elimination than take the inverse.


And learning how to code is going to be more useful to you in the real world than knowing Linear Algebra in the long run. Math is obviously really important from a conceptual point of view, but from a practical point of view, programming is your lifeblood in most STEM fields.
From the void I am born into wave and particle
]343[
Profile Blog Joined May 2008
United States10328 Posts
May 16 2013 17:33 GMT
#10
On May 16 2013 16:01 jalstar wrote:
Write a linear algebra calculator in C++ or Java or something, you'll quickly see why you'd rather do Gaussian elimination than take the inverse.


I thought the computationally easiest way to take the inverse is to do Gaussian elimination anyway? haha

And @corpuscle: I think being comfortable with matrices/their manipulations is pretty important in a number of algorithms (graphics; optimization; fast fourier transform, etc). But I suppose you can learn how to code without knowing anything about algorithms




Back to OP's questions:

1. Yes, as explained by lots of people.
2. Calculus is mostly orthogonal to linear algebra (ha, ha).
3. Probably, since it's an "intro" class.

On the textbook: It doesn't actually cover that much, but it might be a good intro? Didn't look at it closely enough to be sure, but it seems like it's trying to introduce some "mathematically rigorous things" while sticking to the "matrix" approach. Unless you think you're going to be doing theory, I'd recommend a more computational book tbh; you usually don't have to think much about vector spaces unless you're doing math or theoretical physics, and can get away with just matrix manipulation and some basic notions (I guess invertibility / diagonalization / eigenvectors are probably still important). If you'd like to do theory, this book might be ok, though I've heard lots of recommendations for Axler's Linear Algebra Done Right (which tries its darndest to avoid matrices for as long as possible!)

Personally, I learned linear algebra in a sort of "hybrid" way (really, as a subset of my abstract algebra course), and as a result I only sort of know the theory and can't compute very well Probably more my fault than the course's, but I'd still recommend taking some time to pursue either the computational or the theoretical side in some detail.
Writer
ymir233
Profile Blog Joined June 2010
United States8275 Posts
Last Edited: 2013-05-16 20:48:43
May 16 2013 20:48 GMT
#11
On May 17 2013 00:35 corpuscle wrote:
Show nested quote +
On May 16 2013 16:01 jalstar wrote:
Write a linear algebra calculator in C++ or Java or something, you'll quickly see why you'd rather do Gaussian elimination than take the inverse.


And learning how to code is going to be more useful to you in the real world than knowing Linear Algebra in the long run. Math is obviously really important from a conceptual point of view, but from a practical point of view, programming is your lifeblood in most STEM fields.


Actually, if you know C/C++/Python/Matlab you're pretty much done, but more math is always useful in research
Come motivate me to be cynical about animus at http://infinityandone.blogspot.com/ // Stork proxy gates are beautiful.
Please log in or register to reply.
Live Events Refresh
CranKy Ducklings
10:00
Sea Duckling Open #142
CranKy Ducklings36
LiquipediaDiscussion
PiG Sty Festival
09:00
PiGFest 7 Playoffs Day 2
Reynor vs TBDLIVE!
TBD vs SHIN
PiGStarcraft1604
ComeBackTV 1254
IndyStarCraft 190
BRAT_OK 168
Rex152
3DClanTV 102
LiquipediaDiscussion
[ Submit Event ]
Live Streams
Refresh
StarCraft 2
PiGStarcraft1604
IndyStarCraft 190
BRAT_OK 168
Rex 152
StarCraft: Brood War
Britney 37633
Rain 2427
Jaedong 996
Light 437
Larva 360
Stork 283
Leta 175
Last 124
Pusan 91
sorry 67
[ Show more ]
Snow 56
ggaemo 52
yabsab 33
NaDa 27
JYJ 22
Movie 15
Terrorterran 13
ivOry 6
Dota 2
XaKoH 694
XcaliburYe238
Fuzer 168
NeuroSwarm139
Counter-Strike
kRYSTAL_50
Heroes of the Storm
Khaldor147
MindelVK17
Other Games
singsing2547
B2W.Neo483
C9.Mang0312
Dewaltoss62
Mew2King41
White-Ra11
Organizations
Other Games
gamesdonequick712
Counter-Strike
PGL370
StarCraft 2
Blizzard YouTube
StarCraft: Brood War
BSLTrovo
sctven
[ Show 13 non-featured ]
StarCraft 2
• LUISG 22
• AfreecaTV YouTube
• intothetv
• Kozan
• IndyKCrew
• LaughNgamezSOOP
• Migwel
• sooper7s
StarCraft: Brood War
• BSLYoutube
• STPLYoutube
• ZZZeroYoutube
League of Legends
• Jankos1395
• Stunt793
Upcoming Events
OSC
8m
Belair 3
SC Evo Complete
2h 38m
DaveTesta Events
7h 23m
AI Arena Tournament
9h 8m
Replay Cast
13h 8m
PiG Sty Festival
22h 8m
Maru vs TBD
Sparkling Tuna Cup
23h 8m
uThermal 2v2 Circuit
1d 4h
Replay Cast
1d 22h
Wardi Open
2 days
[ Show More ]
Monday Night Weeklies
2 days
Replay Cast
2 days
Replay Cast
3 days
Replay Cast
4 days
The PondCast
4 days
KCM Race Survival
4 days
Replay Cast
5 days
Replay Cast
6 days
CranKy Ducklings
6 days
Liquipedia Results

Completed

Proleague 2026-02-26
LiuLi Cup: 2025 Grand Finals
Underdog Cup #3

Ongoing

KCM Race Survival 2026 Season 1
Acropolis #4 - TS5
Jeongseon Sooper Cup
Spring Cup 2026
[S:21] ASL SEASON OPEN 2nd Round
[S:21] ASL SEASON OPEN 2nd Round Qualifier
WardiTV Winter 2026
PiG Sty Festival 7.0
Nations Cup 2026
PGL Cluj-Napoca 2026
IEM Kraków 2026
BLAST Bounty Winter 2026
BLAST Bounty Winter Qual
eXTREMESLAND 2025

Upcoming

ASL Season 21: Qualifier #1
ASL Season 21: Qualifier #2
ASL Season 21
Acropolis #4 - TS6
Acropolis #4
IPSL Spring 2026
CSLAN 4
HSC XXIX
uThermal 2v2 2026 Main Event
Bellum Gens Elite Stara Zagora 2026
RSL Revival: Season 4
NationLESS Cup
Asian Champions League 2026
IEM Atlanta 2026
PGL Astana 2026
BLAST Rivals Spring 2026
CCT Season 3 Global Finals
FISSURE Playground #3
IEM Rio 2026
PGL Bucharest 2026
Stake Ranked Episode 1
BLAST Open Spring 2026
ESL Pro League S23 Finals
ESL Pro League S23 Stage 1&2
TLPD

1. ByuN
2. TY
3. Dark
4. Solar
5. Stats
6. Nerchio
7. sOs
8. soO
9. INnoVation
10. Elazer
1. Rain
2. Flash
3. EffOrt
4. Last
5. Bisu
6. Soulkey
7. Mini
8. Sharp
Sidebar Settings...

Advertising | Privacy Policy | Terms Of Use | Contact Us

Original banner artwork: Jim Warren
The contents of this webpage are copyright © 2026 TLnet. All Rights Reserved.