• Log InLog In
  • Register
Liquid`
Team Liquid Liquipedia
EST 09:23
CET 15:23
KST 23:23
  • Home
  • Forum
  • Calendar
  • Streams
  • Liquipedia
  • Features
  • Store
  • EPT
  • TL+
  • StarCraft 2
  • Brood War
  • Smash
  • Heroes
  • Counter-Strike
  • Overwatch
  • Liquibet
  • Fantasy StarCraft
  • TLPD
  • StarCraft 2
  • Brood War
  • Blogs
Forum Sidebar
Events/Features
News
Featured News
RSL Season 3 - Playoffs Preview0RSL Season 3 - RO16 Groups C & D Preview0RSL Season 3 - RO16 Groups A & B Preview2TL.net Map Contest #21: Winners12Intel X Team Liquid Seoul event: Showmatches and Meet the Pros10
Community News
Weekly Cups (Nov 24-30): MaxPax, Clem, herO win2BGE Stara Zagora 2026 announced15[BSL21] Ro.16 Group Stage (C->B->A->D)4Weekly Cups (Nov 17-23): Solar, MaxPax, Clem win3RSL Season 3: RO16 results & RO8 bracket13
StarCraft 2
General
Chinese SC2 server to reopen; live all-star event in Hangzhou Maestros of the Game: Live Finals Preview (RO4) BGE Stara Zagora 2026 announced Weekly Cups (Nov 24-30): MaxPax, Clem, herO win SC2 Proleague Discontinued; SKT, KT, SGK, CJ disband
Tourneys
Sparkling Tuna Cup - Weekly Open Tournament RSL Offline Finals Info - Dec 13 and 14! StarCraft Evolution League (SC Evo Biweekly) RSL Offline FInals Sea Duckling Open (Global, Bronze-Diamond)
Strategy
Custom Maps
Map Editor closed ?
External Content
Mutation # 502 Negative Reinforcement Mutation # 501 Price of Progress Mutation # 500 Fright night Mutation # 499 Chilling Adaptation
Brood War
General
BW General Discussion Which season is the best in ASL? Data analysis on 70 million replays BGH Auto Balance -> http://bghmmr.eu/ [ASL20] Ask the mapmakers — Drop your questions
Tourneys
[Megathread] Daily Proleagues [BSL21] RO16 Group D - Sunday 21:00 CET [BSL21] RO16 Group A - Saturday 21:00 CET [BSL21] RO16 Group B - Sunday 21:00 CET
Strategy
Current Meta Game Theory for Starcraft How to stay on top of macro? PvZ map balance
Other Games
General Games
ZeroSpace Megathread Stormgate/Frost Giant Megathread Nintendo Switch Thread The Perfect Game Path of Exile
Dota 2
Official 'what is Dota anymore' discussion
League of Legends
Heroes of the Storm
Simple Questions, Simple Answers Heroes of the Storm 2.0
Hearthstone
Deck construction bug Heroes of StarCraft mini-set
TL Mafia
Mafia Game Mode Feedback/Ideas TL Mafia Community Thread
Community
General
Russo-Ukrainian War Thread US Politics Mega-thread Things Aren’t Peaceful in Palestine The Big Programming Thread Artificial Intelligence Thread
Fan Clubs
White-Ra Fan Club
Media & Entertainment
[Manga] One Piece Movie Discussion! Anime Discussion Thread
Sports
2024 - 2026 Football Thread Formula 1 Discussion NBA General Discussion
World Cup 2022
Tech Support
Computer Build, Upgrade & Buying Resource Thread
TL Community
Where to ask questions and add stream? The Automated Ban List
Blogs
Physical Exertion During Gam…
TrAiDoS
James Bond movies ranking - pa…
Topin
Thanks for the RSL
Hildegard
Customize Sidebar...

Website Feedback

Closed Threads



Active: 1478 users

The Big Programming Thread - Page 288

Forum Index > General Forum
Post a Reply
Prev 1 286 287 288 289 290 1032 Next
Thread Rules
1. This is not a "do my homework for me" thread. If you have specific questions, ask, but don't post an assignment or homework problem and expect an exact solution.
2. No recruiting for your cockamamie projects (you won't replace facebook with 3 dudes you found on the internet and $20)
3. If you can't articulate why a language is bad, don't start slinging shit about it. Just remember that nothing is worse than making CSS IE6 compatible.
4. Use [code] tags to format code blocks.
mcc
Profile Joined October 2010
Czech Republic4646 Posts
April 22 2013 17:07 GMT
#5741
On April 23 2013 01:40 icystorage wrote:
@mcc

im actually working on the perceptron-like multi-layer network with backpropagation and im kinda relieved it matched your suggestion (means im on the right track)

what im trying to do is use NN to predict stock prices (yes it is impossible but i want to test the NN with these data)
stock has 4 prices, open, low, high and close. i want it to predict the closing price. now, is the training (weight adjustment) separate from the predicting or should i input all the necessary data (technicalities aside, just the procedure) then expect the predicted value?

I am not sure how much experience you have with NNs so I will start with saying that if you are fairly new to them, start with something simpler and when you are well acquainted with the processes move to stock predictions I would actually start with something completely simple like function approximation or some simple classification tasks.

I am not entirely sure what you are asking, but hopefully I guessed correctly.

As for training. You should definitely split your data into at least two sets. One group for training, another one for testing. There is whole science around correct setup of training data, but general answer is, do not mix them. Ideally you would want even more sets for different iterations and their evaluation, but you can ignore that at the start, or read up on it properly

You also need to think quite a lot about input of your network. How much data per prediction do you want it to be based on. Basically how far into the past should the NN look for predicting today's prices. And how detailed it should be. For example you can go 2 last days with all four points and before that use only closing price.

The general training process is :
1) setup weights randomly (or another starting setup)
2) while you are not satisfied
-input one vector of data and run the network
-calculate error based on actual and expected output
-use backpropagation to change weights
3) now test it on testing data and calculate error
4) if satisfied you are done if not
5) either redesign training data or redesign your NN topology/other attributes
obesechicken13
Profile Blog Joined July 2008
United States10467 Posts
Last Edited: 2013-04-22 17:23:20
April 22 2013 17:21 GMT
#5742
On April 23 2013 00:18 mcc wrote:
Show nested quote +
On April 22 2013 23:39 icystorage wrote:
Um okay

1) you can use neural networks to predict an output right?
2) how do you make it predict? do you have to train it?
3) by training it, it adjusts its weight right?
4) if i give NN a pattern of 1,1,1,1,1 will it predict the next number will be 1?
5) heres my general understanding in predicting neural networks
- train the network by feeding it data (it adjusts its weight and compares its output to your EXPECTED, not predicted, output)
- with the current configuration of the weights you now use it to get the predicted output

sorry if its confusing but im also very confused atm

1) yes
2) You can either train it or set the weights "correctly" at the start by using some other process (but you can also call it training)
3) yes
4) Not necessarily. It depends on what patterns you trained it to recognize and also how well you trained it


Note that there is plenty of NN types and they have sometimes quite different ways of setting up weights. So you need to specify which type you are talking about, most likely some perceptron-like multi-layer network with backpropagation ?

Can you elaborate on how this is possible?

Sorry. I'm not challenging you. I barely know enough about NN's so I am curious myself.

A neural network for stock prices sounds logical but as you're aware stocks change very dramatically to inputs you may not have guessed and people have already done this and are paid to do this work. Still, I'm sure your results will be interesting.


6) Here's one more question from me: Do neural networks only work for linear correlations?

And to icystorage:
How many days ahead are you trying to predict? Using how much training data?
If you are only going to look at the past 2 days of data as input it may be easier to use a moving average.
I think in our modern age technology has evolved to become more addictive. The things that don't give us pleasure aren't used as much. Work was never meant to be fun, but doing it makes us happier in the long run.
RoyGBiv_13
Profile Blog Joined August 2010
United States1275 Posts
April 22 2013 17:30 GMT
#5743
On April 23 2013 02:21 obesechicken13 wrote:
Show nested quote +
On April 23 2013 00:18 mcc wrote:
On April 22 2013 23:39 icystorage wrote:
Um okay

1) you can use neural networks to predict an output right?
2) how do you make it predict? do you have to train it?
3) by training it, it adjusts its weight right?
4) if i give NN a pattern of 1,1,1,1,1 will it predict the next number will be 1?
5) heres my general understanding in predicting neural networks
- train the network by feeding it data (it adjusts its weight and compares its output to your EXPECTED, not predicted, output)
- with the current configuration of the weights you now use it to get the predicted output

sorry if its confusing but im also very confused atm

1) yes
2) You can either train it or set the weights "correctly" at the start by using some other process (but you can also call it training)
3) yes
4) Not necessarily. It depends on what patterns you trained it to recognize and also how well you trained it


Note that there is plenty of NN types and they have sometimes quite different ways of setting up weights. So you need to specify which type you are talking about, most likely some perceptron-like multi-layer network with backpropagation ?

Can you elaborate on how this is possible?

Sorry. I'm not challenging you. I barely know enough about NN's so I am curious myself.

A neural network for stock prices sounds logical but as you're aware stocks change very dramatically to inputs you may not have guessed and people have already done this and are paid to do this work. Still, I'm sure your results will be interesting.


6) Here's one more question from me: Do neural networks only work for linear correlations?

And to icystorage:
How many days ahead are you trying to predict? Using how much training data?
If you are only going to look at the past 2 days of data as input it may be easier to use a moving average.


Neural networks are specifically good at non-linear problems. It's basically consecutive matrix multiplication in order to reveal non-linear relationships between inputs and outputs.

Any sufficiently advanced technology is indistinguishable from magic
obesechicken13
Profile Blog Joined July 2008
United States10467 Posts
April 22 2013 20:12 GMT
#5744
On April 23 2013 02:30 RoyGBiv_13 wrote:
Show nested quote +
On April 23 2013 02:21 obesechicken13 wrote:
On April 23 2013 00:18 mcc wrote:
On April 22 2013 23:39 icystorage wrote:
Um okay

1) you can use neural networks to predict an output right?
2) how do you make it predict? do you have to train it?
3) by training it, it adjusts its weight right?
4) if i give NN a pattern of 1,1,1,1,1 will it predict the next number will be 1?
5) heres my general understanding in predicting neural networks
- train the network by feeding it data (it adjusts its weight and compares its output to your EXPECTED, not predicted, output)
- with the current configuration of the weights you now use it to get the predicted output

sorry if its confusing but im also very confused atm

1) yes
2) You can either train it or set the weights "correctly" at the start by using some other process (but you can also call it training)
3) yes
4) Not necessarily. It depends on what patterns you trained it to recognize and also how well you trained it


Note that there is plenty of NN types and they have sometimes quite different ways of setting up weights. So you need to specify which type you are talking about, most likely some perceptron-like multi-layer network with backpropagation ?

Can you elaborate on how this is possible?

Sorry. I'm not challenging you. I barely know enough about NN's so I am curious myself.

A neural network for stock prices sounds logical but as you're aware stocks change very dramatically to inputs you may not have guessed and people have already done this and are paid to do this work. Still, I'm sure your results will be interesting.


6) Here's one more question from me: Do neural networks only work for linear correlations?

And to icystorage:
How many days ahead are you trying to predict? Using how much training data?
If you are only going to look at the past 2 days of data as input it may be easier to use a moving average.


Neural networks are specifically good at non-linear problems. It's basically consecutive matrix multiplication in order to reveal non-linear relationships between inputs and outputs.


I may have used the wrong words.

What if you wanted to predict something that you knew had a roughly exponential growth?
Like say you were given a set of data that matched closed to the input of x^2 + 2y^2 + 5 = z
but you were not given the equation and you wanted to use Neural networks to find it. Could you?
I think in our modern age technology has evolved to become more addictive. The things that don't give us pleasure aren't used as much. Work was never meant to be fun, but doing it makes us happier in the long run.
ekra
Profile Joined December 2010
Spain52 Posts
April 22 2013 21:41 GMT
#5745
hi, this is my first post on this thread
I'd like to know what do I need to learn to make an app for android (I'd like to do something similar to a social network)

I'm a mathematics student and there I have done two subjects on programming (the first one was introductory, the second one was on algorithmics: algorithmic efficiency, sorting...), on both of them we programmed using C++. I also know a bit of java, I watched the videos of this course: http://www.academicearth.org/courses/programming-methodology .

What should I try to learn next?

thanks in advance ^^
obesechicken13
Profile Blog Joined July 2008
United States10467 Posts
Last Edited: 2013-04-22 21:43:09
April 22 2013 21:42 GMT
#5746
On April 23 2013 06:41 ekra wrote:
hi, this is my first post on this thread
I'd like to know what do I need to learn to make an app for android (I'd like to do something similar to a social network)

I'm a mathematics student and there I have done two subjects on programming (the first one was introductory, the second one was on algorithmics: algorithmic efficiency, sorting...), on both of them we programmed using C++. I also know a bit of java, I watched the videos of this course: http://www.academicearth.org/courses/programming-methodology .

What should I try to learn next?

thanks in advance ^^

You should learn making an app for android. If nothing else their tutorials will give you more prereqs to do.
I think in our modern age technology has evolved to become more addictive. The things that don't give us pleasure aren't used as much. Work was never meant to be fun, but doing it makes us happier in the long run.
fabiano
Profile Blog Joined August 2009
Brazil4644 Posts
April 22 2013 21:43 GMT
#5747
On April 23 2013 06:41 ekra wrote:
hi, this is my first post on this thread
I'd like to know what do I need to learn to make an app for android (I'd like to do something similar to a social network)

I'm a mathematics student and there I have done two subjects on programming (the first one was introductory, the second one was on algorithmics: algorithmic efficiency, sorting...), on both of them we programmed using C++. I also know a bit of java, I watched the videos of this course: http://www.academicearth.org/courses/programming-methodology .

What should I try to learn next?

thanks in advance ^^


http://developer.android.com/training/basics/firstapp/index.html

Very very easy, and complete documentation.
"When the geyser died, a probe came out" - SirJolt
icystorage
Profile Blog Joined November 2008
Jollibee19350 Posts
Last Edited: 2013-04-22 23:23:03
April 22 2013 23:22 GMT
#5748
@mcc

yes i am really new and just trying to learn about NNs through reading. thank you for that elaborate answer, you have really cleared the air inside the confusion in my brain. +1

@obesechicken

we were planning to use 15 years worth of daily data. is that too much for training? overtraining? and a month worth of data for testing.
LiquidDota StaffAre you ready for a Miracle-? We are! The International 2017 Champions!
WolfintheSheep
Profile Joined June 2011
Canada14127 Posts
Last Edited: 2013-04-23 00:06:11
April 23 2013 00:03 GMT
#5749
On April 23 2013 05:12 obesechicken13 wrote:
Show nested quote +
On April 23 2013 02:30 RoyGBiv_13 wrote:
On April 23 2013 02:21 obesechicken13 wrote:
On April 23 2013 00:18 mcc wrote:
On April 22 2013 23:39 icystorage wrote:
Um okay

1) you can use neural networks to predict an output right?
2) how do you make it predict? do you have to train it?
3) by training it, it adjusts its weight right?
4) if i give NN a pattern of 1,1,1,1,1 will it predict the next number will be 1?
5) heres my general understanding in predicting neural networks
- train the network by feeding it data (it adjusts its weight and compares its output to your EXPECTED, not predicted, output)
- with the current configuration of the weights you now use it to get the predicted output

sorry if its confusing but im also very confused atm

1) yes
2) You can either train it or set the weights "correctly" at the start by using some other process (but you can also call it training)
3) yes
4) Not necessarily. It depends on what patterns you trained it to recognize and also how well you trained it


Note that there is plenty of NN types and they have sometimes quite different ways of setting up weights. So you need to specify which type you are talking about, most likely some perceptron-like multi-layer network with backpropagation ?

Can you elaborate on how this is possible?

Sorry. I'm not challenging you. I barely know enough about NN's so I am curious myself.

A neural network for stock prices sounds logical but as you're aware stocks change very dramatically to inputs you may not have guessed and people have already done this and are paid to do this work. Still, I'm sure your results will be interesting.


6) Here's one more question from me: Do neural networks only work for linear correlations?

And to icystorage:
How many days ahead are you trying to predict? Using how much training data?
If you are only going to look at the past 2 days of data as input it may be easier to use a moving average.


Neural networks are specifically good at non-linear problems. It's basically consecutive matrix multiplication in order to reveal non-linear relationships between inputs and outputs.


I may have used the wrong words.

What if you wanted to predict something that you knew had a roughly exponential growth?
Like say you were given a set of data that matched closed to the input of x^2 + 2y^2 + 5 = z
but you were not given the equation and you wanted to use Neural networks to find it. Could you?

Okay, the question to ask is...what is your actual end goal? Is using a Neural Network a requirement in your mind? Or are you primarily trying to determine a formula to match given data points, and then extrapolate the data further?

Yes, you could, technically, use a Neural Network to do such a thing. However, it would be extremely inefficient to do so, given that your time would be much better spent looking into Discrete Mathematics, where there are already established theorems and equations for such tasks. I think the study is called Recurrence relations...it's been awhile though, so I could be wrong.


EDIT: Sorry, I appear to have randomly jumped into the conversation at an odd point. My point really only applies to deriving a formula from data, not to any sort of predictive software.
Average means I'm better than half of you.
Ame
Profile Joined October 2009
United States246 Posts
April 23 2013 01:26 GMT
#5750
On April 22 2013 10:20 obesechicken13 wrote:
I'm starting to dislike coursera again. I hate formal courses. I was able to do a project today: a rock paper scissors lizard spock game, but I didn't like having to watch video lectures.


Haha, ended up signing up for coursera's intro interaactive python after reading a few comments in this thread.

I haven't actually gone through any of the material/lectures yet, but it looks like they have the concepts in written form if you go to Class > Video Lectures > Week# > Week# Concepts (button that looks like 'i').
Nazza
Profile Blog Joined August 2010
Australia1654 Posts
April 23 2013 07:41 GMT
#5751
On April 23 2013 06:43 fabiano wrote:
Show nested quote +
On April 23 2013 06:41 ekra wrote:
hi, this is my first post on this thread
I'd like to know what do I need to learn to make an app for android (I'd like to do something similar to a social network)

I'm a mathematics student and there I have done two subjects on programming (the first one was introductory, the second one was on algorithmics: algorithmic efficiency, sorting...), on both of them we programmed using C++. I also know a bit of java, I watched the videos of this course: http://www.academicearth.org/courses/programming-methodology .

What should I try to learn next?

thanks in advance ^^


http://developer.android.com/training/basics/firstapp/index.html

Very very easy, and complete documentation.


I think here too:

https://developers.google.com/university/courses/
No one ever remembers second place, eh? eh? GIVE ME COMMAND
billy5000
Profile Blog Joined December 2010
United States865 Posts
April 23 2013 08:11 GMT
#5752
On April 23 2013 10:26 Ame wrote:
Show nested quote +
On April 22 2013 10:20 obesechicken13 wrote:
I'm starting to dislike coursera again. I hate formal courses. I was able to do a project today: a rock paper scissors lizard spock game, but I didn't like having to watch video lectures.


Haha, ended up signing up for coursera's intro interaactive python after reading a few comments in this thread.

I haven't actually gone through any of the material/lectures yet, but it looks like they have the concepts in written form if you go to Class > Video Lectures > Week# > Week# Concepts (button that looks like 'i').


Well for me, I really don't mind the lectures. I realize that most of these professors are well more educated and actually has the ability to teach other than doing research (unlike most of my professors at a state university).

I'm currently taking the scala course, and there's never a time when I'm bored by the lectures. But at the same time, it could be due to the way I take the online course: I spend 20-30min worth of lectures a day, so I don't burn myself out since I have other classwork to do. And plus, it's just easier to retain what I learn in chunks. It sounds corny but I also take notes and pause the video at almost every slide until I can understand the damn thing in my own words lol.

Considering the class you're taking is fairly introductory, I can see why you get bored of the lectures. But maybe try taking it by a little each day--you have the whole week to finish it. I can't guarantee anything, but it's worth a shot.
Tiger got to hunt, bird got to fly; Man got to sit and wonder, 'Why, why, why?' Tiger got to sleep, bird got to land; Man got to tell himself he understand. Vonnegut
Ame
Profile Joined October 2009
United States246 Posts
April 23 2013 10:03 GMT
#5753
On April 23 2013 17:11 billy5000 wrote:
Well for me, I really don't mind the lectures. I realize that most of these professors are well more educated and actually has the ability to teach other than doing research (unlike most of my professors at a state university).

I'm currently taking the scala course, and there's never a time when I'm bored by the lectures. But at the same time, it could be due to the way I take the online course: I spend 20-30min worth of lectures a day, so I don't burn myself out since I have other classwork to do. And plus, it's just easier to retain what I learn in chunks. It sounds corny but I also take notes and pause the video at almost every slide until I can understand the damn thing in my own words lol.

Considering the class you're taking is fairly introductory, I can see why you get bored of the lectures. But maybe try taking it by a little each day--you have the whole week to finish it. I can't guarantee anything, but it's worth a shot.


For me, given my current lifestyle, going through the lectures is probably one of the more productive things I can do anyways (repetition aiding learning etc etc). So yep, I might as well watch them.

Scala course eh. Might add/take that one too. :<
mcc
Profile Joined October 2010
Czech Republic4646 Posts
April 23 2013 13:14 GMT
#5754
On April 23 2013 02:21 obesechicken13 wrote:
Show nested quote +
On April 23 2013 00:18 mcc wrote:
On April 22 2013 23:39 icystorage wrote:
Um okay

1) you can use neural networks to predict an output right?
2) how do you make it predict? do you have to train it?
3) by training it, it adjusts its weight right?
4) if i give NN a pattern of 1,1,1,1,1 will it predict the next number will be 1?
5) heres my general understanding in predicting neural networks
- train the network by feeding it data (it adjusts its weight and compares its output to your EXPECTED, not predicted, output)
- with the current configuration of the weights you now use it to get the predicted output

sorry if its confusing but im also very confused atm

1) yes
2) You can either train it or set the weights "correctly" at the start by using some other process (but you can also call it training)
3) yes
4) Not necessarily. It depends on what patterns you trained it to recognize and also how well you trained it


Note that there is plenty of NN types and they have sometimes quite different ways of setting up weights. So you need to specify which type you are talking about, most likely some perceptron-like multi-layer network with backpropagation ?

Can you elaborate on how this is possible?

Sorry. I'm not challenging you. I barely know enough about NN's so I am curious myself.

A neural network for stock prices sounds logical but as you're aware stocks change very dramatically to inputs you may not have guessed and people have already done this and are paid to do this work. Still, I'm sure your results will be interesting.


6) Here's one more question from me: Do neural networks only work for linear correlations?

And to icystorage:
How many days ahead are you trying to predict? Using how much training data?
If you are only going to look at the past 2 days of data as input it may be easier to use a moving average.

Well if you have training data like this [1,1,1,1,1 -> 0] then properly trained network will answer 0 to input [1,1,1,1,1] My point was more that you can train the network to answer whatever you want, so asking if neural network will answer 1 to [1,1,1,1,1] is dependent on what you trained it to do.

Of course some NNs use some self-organization mechanisms instead of typical training to set their weights and they work somewhat differently.

On April 23 2013 05:12 obesechicken13 wrote:
Show nested quote +
On April 23 2013 02:30 RoyGBiv_13 wrote:
On April 23 2013 02:21 obesechicken13 wrote:
On April 23 2013 00:18 mcc wrote:
On April 22 2013 23:39 icystorage wrote:
Um okay

1) you can use neural networks to predict an output right?
2) how do you make it predict? do you have to train it?
3) by training it, it adjusts its weight right?
4) if i give NN a pattern of 1,1,1,1,1 will it predict the next number will be 1?
5) heres my general understanding in predicting neural networks
- train the network by feeding it data (it adjusts its weight and compares its output to your EXPECTED, not predicted, output)
- with the current configuration of the weights you now use it to get the predicted output

sorry if its confusing but im also very confused atm

1) yes
2) You can either train it or set the weights "correctly" at the start by using some other process (but you can also call it training)
3) yes
4) Not necessarily. It depends on what patterns you trained it to recognize and also how well you trained it


Note that there is plenty of NN types and they have sometimes quite different ways of setting up weights. So you need to specify which type you are talking about, most likely some perceptron-like multi-layer network with backpropagation ?

Can you elaborate on how this is possible?

Sorry. I'm not challenging you. I barely know enough about NN's so I am curious myself.

A neural network for stock prices sounds logical but as you're aware stocks change very dramatically to inputs you may not have guessed and people have already done this and are paid to do this work. Still, I'm sure your results will be interesting.


6) Here's one more question from me: Do neural networks only work for linear correlations?

And to icystorage:
How many days ahead are you trying to predict? Using how much training data?
If you are only going to look at the past 2 days of data as input it may be easier to use a moving average.


Neural networks are specifically good at non-linear problems. It's basically consecutive matrix multiplication in order to reveal non-linear relationships between inputs and outputs.


I may have used the wrong words.

What if you wanted to predict something that you knew had a roughly exponential growth?
Like say you were given a set of data that matched closed to the input of x^2 + 2y^2 + 5 = z
but you were not given the equation and you wanted to use Neural networks to find it. Could you?

Are you asking about neural network approximating the function or are you asking about neural network recognizing the function ?

As for approximation there is actually reasonable number of theoretical results. Basically you can say that perceptron-like networks with at least one hidden layer are "universal approximators" as long as activation function is "nice". If I recall correctly that basically means anything but polynomial activation function. As for classes of functions that can be "approximated" - continuous functions can and even functions that are not continuous in some points if they satisfy some criteria.

As for "recognizing the function" as in providing you with symbolic representation, that depends what exactly you want. You can train it to recognize general type of function, or you can train it to provide you with parameters of the specific class of functions, but then it only works if on the input there will be instances of that class of functions. But as someone pointed out below there are most likely better tools for doing that.

obesechicken13
Profile Blog Joined July 2008
United States10467 Posts
April 23 2013 13:50 GMT
#5755
On April 23 2013 22:14 mcc wrote:
Show nested quote +
On April 23 2013 05:12 obesechicken13 wrote:
On April 23 2013 02:30 RoyGBiv_13 wrote:
On April 23 2013 02:21 obesechicken13 wrote:
On April 23 2013 00:18 mcc wrote:
On April 22 2013 23:39 icystorage wrote:
Um okay

1) you can use neural networks to predict an output right?
2) how do you make it predict? do you have to train it?
3) by training it, it adjusts its weight right?
4) if i give NN a pattern of 1,1,1,1,1 will it predict the next number will be 1?
5) heres my general understanding in predicting neural networks
- train the network by feeding it data (it adjusts its weight and compares its output to your EXPECTED, not predicted, output)
- with the current configuration of the weights you now use it to get the predicted output

sorry if its confusing but im also very confused atm

1) yes
2) You can either train it or set the weights "correctly" at the start by using some other process (but you can also call it training)
3) yes
4) Not necessarily. It depends on what patterns you trained it to recognize and also how well you trained it


Note that there is plenty of NN types and they have sometimes quite different ways of setting up weights. So you need to specify which type you are talking about, most likely some perceptron-like multi-layer network with backpropagation ?

Can you elaborate on how this is possible?

Sorry. I'm not challenging you. I barely know enough about NN's so I am curious myself.

A neural network for stock prices sounds logical but as you're aware stocks change very dramatically to inputs you may not have guessed and people have already done this and are paid to do this work. Still, I'm sure your results will be interesting.


6) Here's one more question from me: Do neural networks only work for linear correlations?

And to icystorage:
How many days ahead are you trying to predict? Using how much training data?
If you are only going to look at the past 2 days of data as input it may be easier to use a moving average.


Neural networks are specifically good at non-linear problems. It's basically consecutive matrix multiplication in order to reveal non-linear relationships between inputs and outputs.


I may have used the wrong words.

What if you wanted to predict something that you knew had a roughly exponential growth?
Like say you were given a set of data that matched closed to the input of x^2 + 2y^2 + 5 = z
but you were not given the equation and you wanted to use Neural networks to find it. Could you?

Are you asking about neural network approximating the function or are you asking about neural network recognizing the function ?

As for approximation there is actually reasonable number of theoretical results. Basically you can say that perceptron-like networks with at least one hidden layer are "universal approximators" as long as activation function is "nice". If I recall correctly that basically means anything but polynomial activation function. As for classes of functions that can be "approximated" - continuous functions can and even functions that are not continuous in some points if they satisfy some criteria.

As for "recognizing the function" as in providing you with symbolic representation, that depends what exactly you want. You can train it to recognize general type of function, or you can train it to provide you with parameters of the specific class of functions, but then it only works if on the input there will be instances of that class of functions. But as someone pointed out below there are most likely better tools for doing that.


I meant for approximating.
If I recall correctly that basically means anything but polynomial activation function.
. I see... I see. Now explain it to me like I am 5?
I think in our modern age technology has evolved to become more addictive. The things that don't give us pleasure aren't used as much. Work was never meant to be fun, but doing it makes us happier in the long run.
mcc
Profile Joined October 2010
Czech Republic4646 Posts
Last Edited: 2013-04-23 16:36:06
April 23 2013 16:32 GMT
#5756
On April 23 2013 22:50 obesechicken13 wrote:
Show nested quote +
On April 23 2013 22:14 mcc wrote:
On April 23 2013 05:12 obesechicken13 wrote:
On April 23 2013 02:30 RoyGBiv_13 wrote:
On April 23 2013 02:21 obesechicken13 wrote:
On April 23 2013 00:18 mcc wrote:
On April 22 2013 23:39 icystorage wrote:
Um okay

1) you can use neural networks to predict an output right?
2) how do you make it predict? do you have to train it?
3) by training it, it adjusts its weight right?
4) if i give NN a pattern of 1,1,1,1,1 will it predict the next number will be 1?
5) heres my general understanding in predicting neural networks
- train the network by feeding it data (it adjusts its weight and compares its output to your EXPECTED, not predicted, output)
- with the current configuration of the weights you now use it to get the predicted output

sorry if its confusing but im also very confused atm

1) yes
2) You can either train it or set the weights "correctly" at the start by using some other process (but you can also call it training)
3) yes
4) Not necessarily. It depends on what patterns you trained it to recognize and also how well you trained it


Note that there is plenty of NN types and they have sometimes quite different ways of setting up weights. So you need to specify which type you are talking about, most likely some perceptron-like multi-layer network with backpropagation ?

Can you elaborate on how this is possible?

Sorry. I'm not challenging you. I barely know enough about NN's so I am curious myself.

A neural network for stock prices sounds logical but as you're aware stocks change very dramatically to inputs you may not have guessed and people have already done this and are paid to do this work. Still, I'm sure your results will be interesting.


6) Here's one more question from me: Do neural networks only work for linear correlations?

And to icystorage:
How many days ahead are you trying to predict? Using how much training data?
If you are only going to look at the past 2 days of data as input it may be easier to use a moving average.


Neural networks are specifically good at non-linear problems. It's basically consecutive matrix multiplication in order to reveal non-linear relationships between inputs and outputs.


I may have used the wrong words.

What if you wanted to predict something that you knew had a roughly exponential growth?
Like say you were given a set of data that matched closed to the input of x^2 + 2y^2 + 5 = z
but you were not given the equation and you wanted to use Neural networks to find it. Could you?

Are you asking about neural network approximating the function or are you asking about neural network recognizing the function ?

As for approximation there is actually reasonable number of theoretical results. Basically you can say that perceptron-like networks with at least one hidden layer are "universal approximators" as long as activation function is "nice". If I recall correctly that basically means anything but polynomial activation function. As for classes of functions that can be "approximated" - continuous functions can and even functions that are not continuous in some points if they satisfy some criteria.

As for "recognizing the function" as in providing you with symbolic representation, that depends what exactly you want. You can train it to recognize general type of function, or you can train it to provide you with parameters of the specific class of functions, but then it only works if on the input there will be instances of that class of functions. But as someone pointed out below there are most likely better tools for doing that.


I meant for approximating.
Show nested quote +
If I recall correctly that basically means anything but polynomial activation function.
. I see... I see. Now explain it to me like I am 5?

I do not think that is possible, unless you are very gifted 5-year old

I will try. Neurons in the neural network have weighted input, output of the neuron is f(x) where x is that input and f is activation function. Most commonly it is sigmoid function, but that is not necessary. The result says that any activation function is good enough for the network to be universal approximator as long as f is non-polynomial.

In general it is described here : Universal approximation theorem.

The specific result I talked about is in link .

Hopefully the link works.

EDIT: for completeness, being non-polynomial is not the only requirement, it needs to be "nice" in other ways, but those are fairly common requirements, unlike being non-polynomial. The other requirements are "locally bounded piecewise continuous".
lannisport
Profile Joined February 2012
878 Posts
Last Edited: 2013-04-23 23:17:37
April 23 2013 18:58 GMT
#5757
I'm pretty new to responsive design so I was wondering if someone could recommend me a lightweight CSS framework that is i.e.a 960 grid system, 7+ compatible, cross browser compatible, has all the major media queries covered, that maybe comes with a very barebones JS function that covers all the crappy old browsers. I'm designing a very basic responsive site because a lot of the users are iphone people so I just need to hide certain page elements at certain widths etc. I've triedaphy messing with bootstrap but it's a little bloated for my use (I'm also using Genesis for wordpress so I'm making a child theme). Best one I like so far is Gumby. Anyone else have any other suggestions?

As a bonus, are there any preset typography/styles out there that look nice and is web friendly?

Eta: I think I found exactly what I was looking for in skeleton.

http://www.getskeleton.com/#
HadeCiao
Profile Joined January 2012
Guatemala81 Posts
Last Edited: 2013-05-23 02:23:38
April 24 2013 00:12 GMT
#5758
As for approximation there is actually reasonable number of theoretical results. Basically you can say that perceptron-like networks with at least one hidden layer are "universal approximators" as long as activation function is "nice". If I recall correctly that basically means anything but polynomial activation function. As for classes of functions that can be "approximated" - continuous functions can and even functions that are not continuous in some points if they satisfy some criteria.
3 pool
Blisse
Profile Blog Joined July 2010
Canada3710 Posts
April 24 2013 02:39 GMT
#5759
On April 24 2013 03:58 lannisport wrote:
I'm pretty new to responsive design so I was wondering if someone could recommend me a lightweight CSS framework that is i.e.a 960 grid system, 7+ compatible, cross browser compatible, has all the major media queries covered, that maybe comes with a very barebones JS function that covers all the crappy old browsers. I'm designing a very basic responsive site because a lot of the users are iphone people so I just need to hide certain page elements at certain widths etc. I've triedaphy messing with bootstrap but it's a little bloated for my use (I'm also using Genesis for wordpress so I'm making a child theme). Best one I like so far is Gumby. Anyone else have any other suggestions?

As a bonus, are there any preset typography/styles out there that look nice and is web friendly?

Eta: I think I found exactly what I was looking for in skeleton.

http://www.getskeleton.com/#

http://960.gs/ is popular as well.
There is no one like you in the universe.
white_horse
Profile Joined July 2010
1019 Posts
April 24 2013 02:51 GMT
#5760
Is it possible to teach yourself HTML and be pretty good at it? I'm planning on studying intensively on my own this summer.

Also, should I learn HTML first or PHP, or should I study both at the same time?
Translator
Prev 1 286 287 288 289 290 1032 Next
Please log in or register to reply.
Live Events Refresh
Next event in 1h 37m
[ Submit Event ]
Live Streams
Refresh
StarCraft 2
Lowko398
LamboSC2 146
ProTech124
StarCraft: Brood War
Britney 41172
Calm 4341
Jaedong 1592
GuemChi 1352
Shuttle 999
EffOrt 894
Mini 766
Soma 749
Soulkey 468
firebathero 324
[ Show more ]
Rush 320
ZerO 313
Snow 260
BeSt 245
Light 175
Zeus 159
Sharp 101
Hyun 86
Pusan 81
BRAT_OK 67
ggaemo 60
Sea.KH 54
Barracks 53
yabsab 52
Killer 44
sorry 44
Mong 42
Aegong 40
hero 37
ToSsGirL 25
soO 21
Bale 18
Sacsri 18
scan(afreeca) 16
Terrorterran 15
SilentControl 13
Shinee 12
ajuk12(nOOB) 11
JulyZerg 9
HiyA 6
Dota 2
singsing2372
qojqva2290
Gorgc1358
Dendi604
syndereN196
XcaliburYe127
Counter-Strike
fl0m4484
zeus3804
olofmeister659
markeloff60
oskar49
Heroes of the Storm
Khaldor29
Other Games
hiko1272
B2W.Neo1022
crisheroes497
DeMusliM257
Hui .209
Mew2King77
ArmadaUGS64
MindelVK10
ZerO(Twitch)9
Organizations
StarCraft 2
WardiTV574
Blizzard YouTube
StarCraft: Brood War
BSLTrovo
sctven
[ Show 14 non-featured ]
StarCraft 2
• AfreecaTV YouTube
• intothetv
• Kozan
• IndyKCrew
• LaughNgamezSOOP
• Migwel
• sooper7s
StarCraft: Brood War
• HerbMon 29
• BSLYoutube
• STPLYoutube
• ZZZeroYoutube
Dota 2
• C_a_k_e 2551
League of Legends
• Jankos2423
Other Games
• WagamamaTV222
Upcoming Events
OSC
1h 37m
Demi vs Mixu
Nicoract vs TBD
Babymarine vs MindelVK
ForJumy vs TBD
Shameless vs Percival
Replay Cast
9h 37m
Korean StarCraft League
1d 12h
CranKy Ducklings
1d 19h
WardiTV 2025
1d 21h
SC Evo League
1d 22h
BSL 21
2 days
Sziky vs OyAji
Gypsy vs eOnzErG
OSC
2 days
Solar vs Creator
ByuN vs Gerald
Percival vs Babymarine
Moja vs Krystianer
EnDerr vs ForJumy
sebesdes vs Nicoract
Sparkling Tuna Cup
2 days
WardiTV 2025
2 days
[ Show More ]
OSC
3 days
BSL 21
3 days
Bonyth vs StRyKeR
Tarson vs Dandy
Replay Cast
3 days
Wardi Open
3 days
StarCraft2.fi
4 days
Monday Night Weeklies
4 days
Replay Cast
4 days
WardiTV 2025
4 days
StarCraft2.fi
5 days
PiGosaur Monday
5 days
StarCraft2.fi
6 days
Tenacious Turtle Tussle
6 days
The PondCast
6 days
WardiTV 2025
6 days
Liquipedia Results

Completed

Proleague 2025-11-30
RSL Revival: Season 3
Light HT

Ongoing

C-Race Season 1
IPSL Winter 2025-26
KCM Race Survival 2025 Season 4
YSL S2
BSL Season 21
CSCL: Masked Kings S3
Slon Tour Season 2
Acropolis #4 - TS3
META Madness #9
SL Budapest Major 2025
ESL Impact League Season 8
BLAST Rivals Fall 2025
IEM Chengdu 2025
PGL Masters Bucharest 2025
Thunderpick World Champ.
CS Asia Championships 2025
ESL Pro League S22
StarSeries Fall 2025
FISSURE Playground #2

Upcoming

BSL 21 Non-Korean Championship
Acropolis #4
IPSL Spring 2026
Bellum Gens Elite Stara Zagora 2026
HSC XXVIII
RSL Offline Finals
WardiTV 2025
Kuram Kup
PGL Cluj-Napoca 2026
IEM Kraków 2026
BLAST Bounty Winter 2026
BLAST Bounty Winter Qual
eXTREMESLAND 2025
TLPD

1. ByuN
2. TY
3. Dark
4. Solar
5. Stats
6. Nerchio
7. sOs
8. soO
9. INnoVation
10. Elazer
1. Rain
2. Flash
3. EffOrt
4. Last
5. Bisu
6. Soulkey
7. Mini
8. Sharp
Sidebar Settings...

Advertising | Privacy Policy | Terms Of Use | Contact Us

Original banner artwork: Jim Warren
The contents of this webpage are copyright © 2025 TLnet. All Rights Reserved.