• Log InLog In
  • Register
Liquid`
Team Liquid Liquipedia
EST 15:24
CET 21:24
KST 05:24
  • Home
  • Forum
  • Calendar
  • Streams
  • Liquipedia
  • Features
  • Store
  • EPT
  • TL+
  • StarCraft 2
  • Brood War
  • Smash
  • Heroes
  • Counter-Strike
  • Overwatch
  • Liquibet
  • Fantasy StarCraft
  • TLPD
  • StarCraft 2
  • Brood War
  • Blogs
Forum Sidebar
Events/Features
News
Featured News
RSL Season 3 - Playoffs Preview0RSL Season 3 - RO16 Groups C & D Preview0RSL Season 3 - RO16 Groups A & B Preview2TL.net Map Contest #21: Winners12Intel X Team Liquid Seoul event: Showmatches and Meet the Pros10
Community News
[BSL21] Ro.16 Group Stage (C->B->A->D)4Weekly Cups (Nov 17-23): Solar, MaxPax, Clem win3RSL Season 3: RO16 results & RO8 bracket13Weekly Cups (Nov 10-16): Reynor, Solar lead Zerg surge2[TLMC] Fall/Winter 2025 Ladder Map Rotation14
StarCraft 2
General
When will we find out if there are more tournament Weekly Cups (Nov 17-23): Solar, MaxPax, Clem win SC: Evo Complete - Ranked Ladder OPEN ALPHA Weekly Cups (Nov 10-16): Reynor, Solar lead Zerg surge RSL Season 3: RO16 results & RO8 bracket
Tourneys
Tenacious Turtle Tussle [Alpha Pro Series] Nice vs Cure RSL Revival: Season 3 $5,000+ WardiTV 2025 Championship StarCraft Evolution League (SC Evo Biweekly)
Strategy
Custom Maps
Map Editor closed ?
External Content
Mutation # 501 Price of Progress Mutation # 500 Fright night Mutation # 499 Chilling Adaptation Mutation # 498 Wheel of Misfortune|Cradle of Death
Brood War
General
Which season is the best in ASL? Data analysis on 70 million replays sas.vorti stream [BSL21] Ro.16 Group Stage (C->B->A->D) FlaSh on: Biggest Problem With SnOw's Playstyle
Tourneys
[Megathread] Daily Proleagues [BSL21] RO16 Tie Breaker - Group B - Sun 21:00 CET [BSL21] GosuLeague T1 Ro16 - Tue & Thu 22:00 CET [BSL21] RO16 Tie Breaker - Group A - Sat 21:00 CET
Strategy
Game Theory for Starcraft How to stay on top of macro? Current Meta PvZ map balance
Other Games
General Games
Stormgate/Frost Giant Megathread The Perfect Game Nintendo Switch Thread Beyond All Reason Should offensive tower rushing be viable in RTS games?
Dota 2
Official 'what is Dota anymore' discussion
League of Legends
Heroes of the Storm
Simple Questions, Simple Answers Heroes of the Storm 2.0
Hearthstone
Deck construction bug Heroes of StarCraft mini-set
TL Mafia
TL Mafia Community Thread Mafia Game Mode Feedback/Ideas
Community
General
US Politics Mega-thread Russo-Ukrainian War Thread Artificial Intelligence Thread YouTube Thread Things Aren’t Peaceful in Palestine
Fan Clubs
White-Ra Fan Club
Media & Entertainment
[Manga] One Piece Movie Discussion! Anime Discussion Thread
Sports
2024 - 2026 Football Thread Formula 1 Discussion NBA General Discussion MLB/Baseball 2023 TeamLiquid Health and Fitness Initiative For 2023
World Cup 2022
Tech Support
Computer Build, Upgrade & Buying Resource Thread
TL Community
Where to ask questions and add stream? The Automated Ban List
Blogs
Esports Earnings: Bigger Pri…
TrAiDoS
Thanks for the RSL
Hildegard
Saturation point
Uldridge
DnB/metal remix FFO Mick Go…
ImbaTosS
Customize Sidebar...

Website Feedback

Closed Threads



Active: 1870 users

Quick Linear Algebra Question- Not homework

Blogs > Chocolate
Post a Reply
Chocolate
Profile Blog Joined December 2010
United States2350 Posts
Last Edited: 2013-05-15 23:21:04
May 15 2013 22:15 GMT
#1
So, my math was teacher talking recently with me and a few other of the math students at my high school who do math competitions. We were complaining that our school doesn't teach any math beyond Calc BC, while many other schools have at least MVC. He said if our school were to ever have a more advanced class, it would be linear algebra. I looked in to linear algebra, since he said it was pretty easy, and found this book online: the book's page. Be warned, the pdf is quite large (465pages).

I've covered the first chapter (wimpy, I know) but I already have a few questions. Since I don't want to tell my math teacher that I'm studying this yet while I'm only done with the first (pretty basic) chapter, I was hoping that maybe I could put some questions on this blog when I have them.

First question: Is Gauss' method really that important? It seems like these systems of equations could be often solved much faster using simple matrix division, not to mention the ability to simply plug matrices into my calculator. I know that systems with non-specific solutions will still require some manipulation by hand, and that these solutions are probably pretty important since from what I can tell they could yield planes and other shapes in 3rd to xth dimensional spaces, but would these even require Gauss' method? It seems like substitution would be very useful in simplifying some systems, and from what I can tell Gauss' method really only uses elimination.

Second Question: Will I need to know any calculus beyond simple derivatives and integrals? The book description says no, but if I were to take a typical, more challenging linear algebra course at a well regarded university, would I need to know something more? It seems that it could at least be important to take the integral of some shapes to find volumes.

Third and final question: Will most universities let me test out of this course in some way? Since I'm interested in mathematics and will likely be going into a STEM field, I want to go in to uni with Calc, MVC, DiffE, and Linear Algebra out of the way to take more theoretical and difficult courses (I guess I would start with Discrete Math?). As much as it could boost my GPA, I don't want to take these math classes over again.

Thanks for your time and if you think the textbook is trash or have a recommendation I'm all ears.

Oh yeah, forgot to mention that I'm also motivated by a desire to do well in the Putnam competition in uni. I'm preparing for it by taking the above courses as well as, at first, working through AMC, AIME, and USAMO problems. If I'm missing a crucial course (I was thinking possibly set theory?) I'd really like to know.

hypercube
Profile Joined April 2010
Hungary2735 Posts
Last Edited: 2013-05-15 22:41:36
May 15 2013 22:41 GMT
#2
You should know how to calculate 154 times 74 on paper even if you always do it using a calculator. Same goes for Gauss's method. There's no point in drilling it for speed or anything like that but you should understand how it works. It's not that hard either, it's exactly the same as solving a system of linear equations by eliminating variables. Except you don't write down the name of variable and insert 0s as needed.

I'm guessing by matrix division you mean multiplying by the inverse. For most larger matrices you do calculate inverses by Gaussian elimination

You don't need any calculus to learn linear algebra. Maybe the book includes a lot of examples from calculus or something. OTOH, multivariable calculus and differential equations do use ideas from linear algebra.

Can't comment on the other questions though.
"Sending people in rockets to other planets is a waste of money better spent on sending rockets into people on this planet."
Chocolate
Profile Blog Joined December 2010
United States2350 Posts
May 15 2013 22:51 GMT
#3
By matrix division I do mean multiplying by the inverse, but I don't mean writing down a matrix and solving it by hand. I'd rather just use Gauss's method. I have a graphing calculator with matrix capabilities so I can just define a matrix A that is x by x , a matrix B that is x by 1 , and multiply the inverse of A by B to get a specific solution very quickly. To me this seems much faster than doing a whole bunch of elimination, putting things in echelon form, and then continually substituting values for variables.

I'm not bad at arithmetic. Hell, I am heavily involved in academic competitions in which I have to do a lot of arithmetic pretty quickly. I don't, however, want to do a lot of arithmetic that will only slow me down.

Thank you for your help! I'm glad I won't have to learn any more calculus.
Muirhead
Profile Blog Joined October 2007
United States556 Posts
May 15 2013 23:35 GMT
#4
When I learned linear algebra in high school I learned from two sources:
First, I looked through Gilbert Strang's MIT OCW videos (look them up) and solved some of MIT's homework problem. Then I read Serge Lang's linear algebra book and did all the proofs from it. I highly recommend Lang's book if you are familiar with proofs from USAMO work. Some of my friends also like the book "Linear Algebra Done Right" by Axler.

There are two ways to learn linear algebra: the engineering way which is full of matrices and the mathematics way which introduces the concept of a vector space and hardly touches explicit matrices.

Regarding skipping linear algebra, any of the better schools will let you skip any math course you want to skip. They may not recommend it, but if you want to walk into algebraic geometry on the first day they will let you. The phrase for this is "enough noose to hang yourself."
starleague.mit.edu
radscorpion9
Profile Blog Joined March 2011
Canada2252 Posts
Last Edited: 2013-05-16 00:35:02
May 16 2013 00:24 GMT
#5
But how would you get the inverse? If your graphing calculator is doing it for you then that explains why its so easy; but otherwise you would need to get matrix A into identity matrix form while performing the same operations to transform an associated identity matrix into the inverse, which is basically the same as echelon row reduction. All of this is covered much, much later in your book, but it looks like you already know!

So either way you would have to go through that echelon row reduction, but the only difference is that with your method there is an extra step of multiplying (A inverse) with B

Also only some matrices have inverses - they have to be square (n x n) and have linearly independent rows/columns, so your method won't always yield a specific solution if you're working with an m x n matrix (where m does not equal n).

Just to be clear there shouldn't be any substitution required except for the trivial observation of what the results are, which you can read off of the reduced matrix. You should be only reducing one matrix, and the answers will be apparent at the end of that reduction without any substitution required.

As far as I'm aware, from my linear algebra course you can only get parametric (infinite) solutions using row reduction, although there may be more advanced ways taught in higher level courses. But I'm pretty sure they move on from linear algebra to non-linear cases. Gaussian elimination is simply a fast way to determine whether equations are linearly independent or dependent, while also providing you with any possible solutions to those equations.

And in my course (which was the more advanced version) we only required basic calculus and differentiation when we were dealing with maps from one vector space to another, which you will learn later. Basically you just integrate/differentiate simple polynomials.

I hope I didn't forget anything crucial or made any errors! I'm in Canada so I don't know the answer to your last question. It was an important prerequisite in my university (Toronto) for more advanced math courses, but I think you could get a transfer credit allowing you to skip that course. There is quite a lot you need to learn in advanced linear algebra beyond elementary matrix multiplication or row reduction. It gets complicated when they start talking about maps, isomorphisms...or maybe I fell behind . Either way if you're considering putnam, I'm sure you'll find it quite nice and easy.
ymir233
Profile Blog Joined June 2010
United States8275 Posts
May 16 2013 02:19 GMT
#6
On May 16 2013 07:15 Chocolate wrote:
So, my math was teacher talking recently with me and a few other of the math students at my high school who do math competitions. We were complaining that our school doesn't teach any math beyond Calc BC, while many other schools have at least MVC. He said if our school were to ever have a more advanced class, it would be linear algebra. I looked in to linear algebra, since he said it was pretty easy, and found this book online: the book's page. Be warned, the pdf is quite large (465pages).

I've covered the first chapter (wimpy, I know) but I already have a few questions. Since I don't want to tell my math teacher that I'm studying this yet while I'm only done with the first (pretty basic) chapter, I was hoping that maybe I could put some questions on this blog when I have them.

First question: Is Gauss' method really that important? It seems like these systems of equations could be often solved much faster using simple matrix division, not to mention the ability to simply plug matrices into my calculator. I know that systems with non-specific solutions will still require some manipulation by hand, and that these solutions are probably pretty important since from what I can tell they could yield planes and other shapes in 3rd to xth dimensional spaces, but would these even require Gauss' method? It seems like substitution would be very useful in simplifying some systems, and from what I can tell Gauss' method really only uses elimination.

Second Question: Will I need to know any calculus beyond simple derivatives and integrals? The book description says no, but if I were to take a typical, more challenging linear algebra course at a well regarded university, would I need to know something more? It seems that it could at least be important to take the integral of some shapes to find volumes.

Third and final question: Will most universities let me test out of this course in some way? Since I'm interested in mathematics and will likely be going into a STEM field, I want to go in to uni with Calc, MVC, DiffE, and Linear Algebra out of the way to take more theoretical and difficult courses (I guess I would start with Discrete Math?). As much as it could boost my GPA, I don't want to take these math classes over again.

Thanks for your time and if you think the textbook is trash or have a recommendation I'm all ears.

Oh yeah, forgot to mention that I'm also motivated by a desire to do well in the Putnam competition in uni. I'm preparing for it by taking the above courses as well as, at first, working through AMC, AIME, and USAMO problems. If I'm missing a crucial course (I was thinking possibly set theory?) I'd really like to know.


Gaussian elimination is important in the sense that addition is important. It sets up the basics for later manipulations. You think you can just plug and chug everything (esp. in numerical computing)? No way. Inverse/substitution is naively decent, but carefully planned Gaussian elimination is much more efficient and less-error prone. Also, you can't do determinant manipulation if you don't know how/why Gaussian elim works.

You won't need much. The derivatives and integrals will be useful for infinite series stuff with matrices/exponential decomposition later.

Most universities shouldn't let you test out, since linalg is just so important in everything mathematics related at the higher level. Talk with your dept head if you really want to do something about it, but you better have the chops (as in, more than just being able to do formula shits like singular value decomposition or Gram-Schmidt...proofs are key).

Strang is decent, has a few errors. Lay is the standard HS book. Axler is nice, more abstract/less computational than a lot. It's one of the few books that doesn't barrel towards Gram-Schmidt as a conclusion.

If you're concerned about Putnam as a high priority, forget about learning linalg straight off the book. Just keep solving random linalg problems while struggling like a mofo looking through AoPS links...basic linear algebra (ESPECIALLY properties of trace/determinant/symmetric/triangular matrices) should be able to get you through 99% of Putnam problems. Although I'm kinda worried about your prospect at Putnam if you're just now getting into AMC/AIME/USAMO....
Come motivate me to be cynical about animus at http://infinityandone.blogspot.com/ // Stork proxy gates are beautiful.
n.DieJokes
Profile Blog Joined November 2008
United States3443 Posts
Last Edited: 2013-05-16 06:10:20
May 16 2013 06:02 GMT
#7
Gauss's Method is Gaussian Elimination right? GE gives you an algorithm to determine the rank of the matrix (which isn't obvious by inspection in most matrices). In regular algebra you'd ask questions like, 2x=3 solve for x and you'd say x=3/2. Now in linear algebra I can ask you Ax=b, does x exist? If x exists, is it the unique solution? If it's not the unique solution, what does the space of solutions look like? What are the possible values of x? The rank gives you an answer to (some) these questions and you find the rank using GE. I mean, it also gives you an easy way to solve Ax=b by inspection but that's not the point.

This is the point, GE illustrates in some the sense the main idea that makes linear algebra work. We can manipulate a matrix into certain forms without altering the fundamental properties of the matrix and in these nice forms we can extract a bunch of information that makes solving the system easy (this is maximally vague lol).

2) Nope, no calculus necessary (although there is interplay of the two and some really nice applications but this is true for linear algebra and just about every branch of mathematics)

3) Usually you take diff eq and multi at a CC and they count that credit. If you just self study, they aren't going to let you skip all these classes based on just your word, you'll have to prove yourself in a course or two first. This isn't a bad thing; in fact, you'll probably gain a lot by taking them even if you're already familiar with the concepts. Self study can make you proficient in vocabulary and problem solving but, especially since you're just starting out with math, its very easy to miss the big picture. The why this stuff matters more than that stuff even though they're both in the chapter. How this material is a generalization of past material and etc. A teacher doesn't just know the material, they know how it all fits together
MyLove + Your Love= Supa Love
jalstar
Profile Blog Joined September 2009
United States8198 Posts
May 16 2013 07:01 GMT
#8
Write a linear algebra calculator in C++ or Java or something, you'll quickly see why you'd rather do Gaussian elimination than take the inverse.
corpuscle
Profile Blog Joined April 2011
United States1967 Posts
May 16 2013 15:35 GMT
#9
On May 16 2013 16:01 jalstar wrote:
Write a linear algebra calculator in C++ or Java or something, you'll quickly see why you'd rather do Gaussian elimination than take the inverse.


And learning how to code is going to be more useful to you in the real world than knowing Linear Algebra in the long run. Math is obviously really important from a conceptual point of view, but from a practical point of view, programming is your lifeblood in most STEM fields.
From the void I am born into wave and particle
]343[
Profile Blog Joined May 2008
United States10328 Posts
May 16 2013 17:33 GMT
#10
On May 16 2013 16:01 jalstar wrote:
Write a linear algebra calculator in C++ or Java or something, you'll quickly see why you'd rather do Gaussian elimination than take the inverse.


I thought the computationally easiest way to take the inverse is to do Gaussian elimination anyway? haha

And @corpuscle: I think being comfortable with matrices/their manipulations is pretty important in a number of algorithms (graphics; optimization; fast fourier transform, etc). But I suppose you can learn how to code without knowing anything about algorithms




Back to OP's questions:

1. Yes, as explained by lots of people.
2. Calculus is mostly orthogonal to linear algebra (ha, ha).
3. Probably, since it's an "intro" class.

On the textbook: It doesn't actually cover that much, but it might be a good intro? Didn't look at it closely enough to be sure, but it seems like it's trying to introduce some "mathematically rigorous things" while sticking to the "matrix" approach. Unless you think you're going to be doing theory, I'd recommend a more computational book tbh; you usually don't have to think much about vector spaces unless you're doing math or theoretical physics, and can get away with just matrix manipulation and some basic notions (I guess invertibility / diagonalization / eigenvectors are probably still important). If you'd like to do theory, this book might be ok, though I've heard lots of recommendations for Axler's Linear Algebra Done Right (which tries its darndest to avoid matrices for as long as possible!)

Personally, I learned linear algebra in a sort of "hybrid" way (really, as a subset of my abstract algebra course), and as a result I only sort of know the theory and can't compute very well Probably more my fault than the course's, but I'd still recommend taking some time to pursue either the computational or the theoretical side in some detail.
Writer
ymir233
Profile Blog Joined June 2010
United States8275 Posts
Last Edited: 2013-05-16 20:48:43
May 16 2013 20:48 GMT
#11
On May 17 2013 00:35 corpuscle wrote:
Show nested quote +
On May 16 2013 16:01 jalstar wrote:
Write a linear algebra calculator in C++ or Java or something, you'll quickly see why you'd rather do Gaussian elimination than take the inverse.


And learning how to code is going to be more useful to you in the real world than knowing Linear Algebra in the long run. Math is obviously really important from a conceptual point of view, but from a practical point of view, programming is your lifeblood in most STEM fields.


Actually, if you know C/C++/Python/Matlab you're pretty much done, but more math is always useful in research
Come motivate me to be cynical about animus at http://infinityandone.blogspot.com/ // Stork proxy gates are beautiful.
Please log in or register to reply.
Live Events Refresh
Next event in 3h 37m
[ Submit Event ]
Live Streams
Refresh
StarCraft 2
mouzHeroMarine 649
White-Ra 248
IndyStarCraft 209
UpATreeSC 114
ForJumy 36
StarCraft: Brood War
Calm 2766
Shuttle 535
Larva 260
Dewaltoss 170
League of Legends
rGuardiaN24
Counter-Strike
fl0m4128
apEX1312
pashabiceps1188
Heroes of the Storm
Liquid`Hasu1305
Other Games
singsing2089
FrodaN1653
B2W.Neo1572
Mew2King143
ArmadaUGS93
Organizations
Dota 2
PGL Dota 2 - Main Stream139
StarCraft: Brood War
lovetv 6
Other Games
Algost 3
StarCraft 2
Blizzard YouTube
StarCraft: Brood War
BSLTrovo
sctven
[ Show 18 non-featured ]
StarCraft 2
• Dystopia_ 2
• IndyKCrew
• sooper7s
• AfreecaTV YouTube
• Migwel
• intothetv
• LaughNgamezSOOP
• Kozan
StarCraft: Brood War
• 80smullet 24
• Azhi_Dahaki15
• STPLYoutube
• ZZZeroYoutube
• BSLYoutube
Dota 2
• Ler1151
• WagamamaTV399
League of Legends
• TFBlade1603
Other Games
• imaqtpie1466
• Shiphtur320
Upcoming Events
Replay Cast
3h 37m
OSC
20h 37m
LAN Event
21h 37m
Replay Cast
1d 2h
Replay Cast
1d 12h
WardiTV Korean Royale
1d 15h
Sparkling Tuna Cup
2 days
WardiTV Korean Royale
2 days
Replay Cast
3 days
Wardi Open
3 days
[ Show More ]
Monday Night Weeklies
3 days
StarCraft2.fi
3 days
Replay Cast
4 days
Wardi Open
4 days
StarCraft2.fi
4 days
Wardi Open
5 days
StarCraft2.fi
5 days
Replay Cast
6 days
The PondCast
6 days
Liquipedia Results

Completed

SOOP Univ League 2025
RSL Revival: Season 3
Eternal Conflict S1

Ongoing

C-Race Season 1
IPSL Winter 2025-26
KCM Race Survival 2025 Season 4
YSL S2
BSL Season 21
CSCL: Masked Kings S3
Slon Tour Season 2
META Madness #9
SL Budapest Major 2025
BLAST Rivals Fall 2025
IEM Chengdu 2025
PGL Masters Bucharest 2025
Thunderpick World Champ.
CS Asia Championships 2025
ESL Pro League S22
StarSeries Fall 2025
FISSURE Playground #2

Upcoming

BSL 21 Non-Korean Championship
Acropolis #4
IPSL Spring 2026
HSC XXVIII
RSL Offline Finals
WardiTV 2025
PGL Cluj-Napoca 2026
IEM Kraków 2026
BLAST Bounty Winter 2026
BLAST Bounty Winter 2026: Closed Qualifier
eXTREMESLAND 2025
ESL Impact League Season 8
TLPD

1. ByuN
2. TY
3. Dark
4. Solar
5. Stats
6. Nerchio
7. sOs
8. soO
9. INnoVation
10. Elazer
1. Rain
2. Flash
3. EffOrt
4. Last
5. Bisu
6. Soulkey
7. Mini
8. Sharp
Sidebar Settings...

Advertising | Privacy Policy | Terms Of Use | Contact Us

Original banner artwork: Jim Warren
The contents of this webpage are copyright © 2025 TLnet. All Rights Reserved.