Questions tagged [regression]

For questions related to regression (both linear and non-linear) in the context of machine learning and AI.

127 questions
18
votes
10 answers

How to classify data which is spiral in shape?

I have been messing around in tensorflow playground. One of the input data sets is a spiral. No matter what input parameters I choose, no matter how wide and deep the neural network I make, I cannot fit the spiral. How do data scientists fit data of…
11
votes
1 answer

Can supervised learning be recast as reinforcement learning problem?

Let's assume that there is a sequence of pairs $(x_i, y_i), (x_{i+1}, y_{i+1}), \dots$ of observations and corresponding labels. Let's also assume that the $x$ is considered as independent variable and $y$ is considered as the variable that depends…
10
votes
3 answers

Do I need classification or regression to predict the availability of a user given some features?

While studying data mining methods I have come to understand that there are two main categories: Predictive methods: Classification Regression Descriptive methods: Clustering Association rules Since I want to predict the user availability…
7
votes
3 answers

Which predictive algorithm can be used to predict a number given other numbers?

I am currently searching for a supervised learning algorithm that can be used to predict the output given a large enough training set. Here's a simple example. Suppose the training dataset is {[A=1, B=330, C=1358.238902], result=234.244378} and the…
5
votes
2 answers

Should the prediction of the body temperature given a camera image be modelled as classification or regression?

I am fairly new to deep learning in general and I am currently facing a problem I want to solve using neural networks and I am unsure if it is a classification or regression problem. I am aware that classification problems are about classifying…
4
votes
1 answer

Which algorithm can I use to minimise the number of wins of 2 weapons that fight each other in a game?

I have a game that involves 2 weapons, which fight against each other. Each weapon has 5 features/statistics, which have certain range. I can simulate the game $N$ times with randomly initialised values for these statitics, in order to collect a…
Aphrodite
  • 87
  • 4
4
votes
0 answers

Can AlexNet be changed to produce floating-point outputs in the range $[-1, 1]$, and, if not, which model should I use?

I'm developing a game AI, which tries to master racing simulation. I already trained a CNN (AlexNet) on in-game footage of me playing the game and the pressed keys as the target. I had two main issues with this setup: Extracting the current speed…
4
votes
1 answer

How to define machine learning to cover clustering, classification, and regression?

How to define machine learning to cover clustering, classification, and regression? What unites these problems?
4
votes
2 answers

Is a basic neural network architecture better with small datasets?

I'm currently trying to predict 1 output value with 52 input values. The problem is that I only have around 100 rows of data that I can use. Will I get more accurate results when I use a small architecture than when I use multiple layers with a…
4
votes
1 answer

What is the best approach for multivariable and multivariate regression?

I want to build a multivariable and multivariate regression model in Keras (with TensorFlow as backend), that is, a regression model with multiple values as input (multivariable) and output (multivariate). The independent variables are, for…
Riz
  • 71
  • 4
3
votes
1 answer

Why is the hyperbolic tangent with MSE better than the sigmoid with cross-entropy?

Usually, in binary classification problems, we use sigmoid as the activation function of the last layer plus the binary cross-entropy as cost function. However, I have already experienced (more than once) that $\tanh$ as activation function of last…
3
votes
1 answer

Is it a good idea to train a CNN to detect the hydration value (percentage) in skin images and evaluate it with the MSE?

I have a large dataset of skin images, each one associated with a hydration value (percentage). Now I'm looking into predicting the hydration value from an image. My thinking: train a CNN on the dataset and evaluate the model with a mean square…
3
votes
1 answer

Regression loss conditioned by the ground-truth values

I'm working on a regression problem with a CNN in which the input is a single image, and the output is an angle in degrees (which determines a specific measure related to the image). Sometimes, the model fails to retrieve the output accurately (for…
3
votes
1 answer

Is it possible to use LLMs for regression tasks?

I want to use LLMs to predict edge weights in a graph based on attributes between two nodes. Is this even possible? If not, what would you recommend? I tried to look up uses of LLM in regression tasks, but haven't had much luck finding anything…
3
votes
0 answers

How can i tinker my neural network to learn stronger on rare events?

I am training a neural network on a regression problem. Most of the time the actual y (label) has the same value (say ~0.2) and only in rare cases the actual y is very different (say 2.0 or -2.0) After training the neural network obviously performs…
1
2 3
8 9