Solution Method for Infinite-Horizon Maximization Problem Full disclosure: this problem was part of a final exam that none of our class could really solve definitively. Below the general form is a specific utility function we worked with that I'll try to replicate my work for. Any help on the solution method would be good; specifically, it seems Euler's equations/steady states would be better for this particular form of question rather than using a Bellman, but any guidance on either method would be appreciated.



Suppose a representative agent is solving

$$
\begin{align}
&amp; \max_{\left\{ c_t, w_t \right\}^\infty_{t=0}} \sum_{t=0}^\infty \beta^t u(c_t) \\
&amp; \text{s.t.} \\
&amp; w_t = Rw_{t-1} - c_t \\
&amp; c_t \geq 0 \\
&amp; w_t \geq 0 \\
\end{align}
$$

For all $t$, and $w_{-1}$. Additionally, $0 &lt; \beta &lt; 1$, $R &gt; 1$. 

$c_t$ is consumption at time $t$, and $w_t$ is wealth at the end of time $t$. $\beta$ is a discount factor.

Let 
$$u(c_t) = \phi \mathrm{e}^ {\theta c_t^p}$$
where $\phi, \theta, p$ are constant parameters.


  My first question is what values of the constants $\phi, \theta$, and $p$ are needed to ensure that $u(c_t)$ are strictly increasing and strictly concave in $c_t$, for all values of $c_t$. Later on the problem asks us to assume those above conditions.


So taking the first and second derivative of $u(c_t)$ gives us:

$$
\begin{align}
u'(c_t) &amp; = \phi \theta p c_t^{p-1}\mathrm{e}^ {\theta c_t^p} \\
u''(c_t) &amp; = \phi \theta p(p-1) c_t^{p-2}\mathrm{e}^ {\theta c_t^p} + \phi \theta ^2 p^2 c_t^{(p-1)^2}\mathrm{e}^ {\theta c_t^p} \\
&amp; = \phi \theta p c_t^{p-1} \mathrm{e}^{\theta c_t^p}\left[ \frac{p-1}{c_t} + \theta p c_t^{p-1} \right] \\
\end{align}$$

So $u'(c_t) &gt; 0$ in order to satisfy the strictly increasing constraint. $u''(c_t) &lt; 0$ must be true for strict concavity. I suggested that $\phi, \theta &gt; 0$ and $p = 1$ for this to be true. I'm not sure how this ugly second derivative can be simplified to find the appropriate conditions.



After doing this, we had to express Bellman's equation and Euler's equation for the problem.

Bellman:

$$\boxed{V(w) = \max_\tilde{w} \left[ \phi \mathrm{e}^{\theta (Rw - \tilde{w})^p} + \beta V(\tilde{w})\right]}$$

Euler:

$$\boxed{\sum_{t=0}^\infty \beta^t (Rw_{t-1} - w_t)^p = \cdots \beta^t (Rw_{t-1} - w_t)^p + \beta^{t+1}(Rw_t - w_{t+1})^p + \cdots }$$



Finally, we got to say that $\beta \cdot R = 1$. We were then asked to find the value function and optimal decision rules for our choice variable(s). I used the Bellman to try to solve the problem, where I guessed the function form of the value function:

$$V(\tilde{w}) = F \mathrm{e}^{M\tilde{w}} + H$$

where $F, M, H$ are undetermined coefficients. After substituting this into the Bellman and putting in appropriate arguments, taking the derivative to get an optimal choice, substituting the optimal choices back into the Bellman, I got stuck trying to solve for $F, M, H$ in a way that would give me a sensible consumption choice at the end.

The little trick with $\beta R = 1$ is supposed to make consumption constant across all periods, so I assume that the point of getting the Euler's equation is so we can solve it using steady states and make life easier, but my algebra there hasn't borne any fruit either it seems.


  For the dynamic programming method, have I set the functional form of the value function correctly? If not, what should be the guess? And finally, how does all the nasty algebra work out?
  
  For the steady states method, what does the path of wealth look like? Does it end up constant as well? (I suppose that question applies for the Bellman approach as well.)


(If it's pedagogically interesting or useful--or if you don't trust that I'm not begging for homework help--I can show my work for both methods.)

Please let me know if anything is unclear.
Your first question (regarding constraints on the parameters) can be answered through first and second derivative analysis. In order to satisfy strictly increasing, we need $u'&gt;0$ and to satisfy strictly concave, we need $u''&lt;0$. What does this actually mean?

$$u'(\frac{}{})=\phi p\theta c_t^{p-1}e^{\theta c_t^p}&gt;0$$
Since we know that $c_t^{p-1}e^{\theta c_t^p}&gt;0$ automatically, this reduces to:
$$\phi p\theta&gt;0$$
Next:
$$u''(\frac{}{})=\big[\phi p\theta (p-1) c_t^{p-2}+\phi p\theta c_t^{p-1}\big]e^{\theta c_t^p}&lt;0$$
Because we know that $e^{\theta c_t^p}&gt;0$ and $\phi p\theta c_t^{p-1}&gt;0$, this must mean: 
$$\phi p\theta (p-1)c_t^{p-2}&lt;0$$

By virtue of $(1)$ and the fact that $c_t^{p-2}&gt;0$, we know that:
$$p-1&lt;0$$
or
$$p&lt;1$$
Now,  what we can do is think about it critically. If $p=0$ then utility does not change when consumption changes. This is clearly untrue. If $p&lt;0$ then utility decreases when consumption increases which also seems incorrect. Therefore, our condition for $p$ is:
$$0&lt;p&lt;1$$
Now, what does this mean for $\phi \;\text{and}\; \theta$? It means: 
$$either\quad\phi , \theta&gt;0\quad or\quad \phi ,\theta&lt;0$$
Now, this looks like a typical exponential utility function, so we know that in these cases, both the coefficient for the exponent and the coefficient in the power will be negative (I will not bother proving this as I am sure it is somewhere in literature). Therefore we have the following three conditions for the parameters:
$$0&lt;p&lt;1$$
$$\theta &lt;0$$
$$\phi &lt;0$$

Now, the next step is to show that we do in fact have constant consumption. Taking our Euler Equation approach, we substitute in the constraint and take two terms in the sum,
$$...+\beta^t\phi e^{\theta (Rw_{t-1}-w_t)^p}+\beta^{t+1}\phi e^{\theta(Rw_t-w_{t+1})^p}+...$$
Differentiating w.r.t $w_t$ and doing some simplifying, we get:
$$(Rw_{t-1}-w_t)^{p-1}e^{\theta(Rw_{t-1}-w_t)^p}=\beta R(Rw_t-w_{t+1})^{p-1}e^{\theta(Rw_t-w_{t+1})^p}$$
Substituting consumption back in, we get:
$$c_t^{p-1}e^{\theta c_t^p}=\beta Rc_{t+1}^{p-1}e^{\theta c_{t+1}^p}$$
Now, since it is specified that $\beta R=1$ in the problem, we can see that the only way this equality holds is if $c_t=c_{t+1}=c^\star$

What does this mean for wealth? Will wealth also be constant? Well, let's conduct a thought experiment and suppose not. Suppose wealth increases each period ($w_{t+1}&gt;w_t\;\forall t$). This implies that as $t\rightarrow \infty$, we will see wealth grow to be infinite as well, which is wasteful and would not satisfy the transversality condition. Now suppose wealth is decreasing ($w_{t+1}&lt;w_t\;\forall t$). We can clearly see that eventually we will not have enough wealth to sustain constant consumption. Therefore we can see that $w_t=w_{t+1}=w^\star$. Now, what are the relationship between these two? Well, going back to our condition for wealth, we can see
$$w^\star=Rw^\star-c^\star$$
Rearranging, we get:
$$c^\star=(R-1)w^\star$$ 

Because we have steady state wealth, we know that $w^\star=w_0$

Now, knowing that we have steady state consumption, we know our utility function will be the same value for every period (discounted by $\beta$). So our value function simply becomes:

$$V(w)=\frac{\phi e^{((R-1)w_0)^p}}{1-\beta}$$ 

Therefore, we do not need to use the method of undetermined coefficients to find the value function.