Some experts tell me that the construction of abelian varieties from
Hilbert modular forms is an (apparently difficult) open problem. However,
in view of the construction of $l$-adic Galois representations due to Carayol for instance, 
it is not clear what exactly the obstruction to the usual method of taking 
the quotient of the jacobian (of the associated quaternionic Shimura curve) by the 
`annihilator' of the associated quaternionic eigenform would be.


To be slightly more precise, consider the setting of Carayol "Sur les représentations galoisiennes modulo $l$ attachées aux formes modulaires" (Duke Math. Journal, 1986). That is, let $F$ be a totally real field of degree $d$, with set of real places $\lbrace \tau\_1, \ldots, \tau\_d \rbrace$. Fix integers $k \geq 2$ and $w$ having the same parity. Let $D\_{k,w}$ denote the representation of $\operatorname{GL\_2}({\bf{R}})$ that occurs via unitary induction as $\operatorname{Ind}(\mu, \nu)$, where $\mu$ and $\nu$ are the characters on ${\bf{R}}^{\times}$ given by


\begin{align\*}
\mu(t) &= \vert t \vert ^{\frac{1}{2}(k-1-w)}\operatorname{sgn}(t)^k; ~~
\nu(t) = \vert t \vert ^{\frac{1}{2}(-k+1-w)}.
\end{align\*} Fix integers $k\_1, \ldots k\_d$ all having the same parity. Let
$\pi \cong \bigotimes\_v \pi\_v$ be a cuspidal automorphic representation of 
$\operatorname{GL\_2}({\bf{A}}\_F)$ such that for each real place $\tau\_i$ of $F$, there is an isomorphism $$\pi\_{\tau\_i} \cong D\_{k\_i, w}.$$ It is well know that such 
representations correspond to holomorphic Hilbert modular 
forms of weight ${\bf{k}}=(k\_1, \ldots, k\_d)$. If $d$ is even, then assume
additionally that there exists a finite prime $v \subset \mathcal{O}\_F$ where
the local component $\pi\_v$ is an "essentially square integrable" (i.e. special or 
cuspidal) representation of $\operatorname{GL\_2}(F\_v)$. Let $B/F$ be a quaternion
algebra that is ramified at $\lbrace \tau\_2, \ldots, \tau\_d \rbrace$ if 
$d$ is odd, and ramified at $\lbrace \tau\_2, \ldots, \tau\_d, v \rbrace$ 
if $d$ is even. Let $$G = \operatorname{Res}\_{F/{\bf{Q}}}(B^{\times})$$ be the associated algebraic group over ${\bf{Q}}$. Hence, we have an isomorphism
$$G({\bf{R}}) \cong \operatorname{GL}({\bf{R}}) \times \left( \mathbb{H}^{\times} \right)^{d-1},$$ where $\mathbb{H}$ denotes the Hamiltonian quaternions. Let $\overline{D}\_{k,w}$ denote the representation of $\mathbb{H}^{\times}$ corresponding to $D\_{k,w}$ via Jacquet-Langlands correspondence. We then consider cuspidal automorphic representations $\pi' = \bigotimes\_v \pi\_v'$ of $G({\bf{A}}\_F)$ such that $\pi\_{\tau\_1}' \cong D\_{k\_1, w}$ and $\pi\_{\tau\_i} \cong \overline{D}\_{k\_i, w}$ for $i = 2, \ldots, d$. Such representations should (I believe) correspond to modular forms of weight ${\bf{k}} = (k\_1, \ldots, k\_d)$ on the indefinite quaternion algebra $B$. To be slightly more precise, let $S\_{\bf{k}}(\mathfrak{m})$ denote the finite dimensional ${\bf{C}}$-vector space of quaternionic modular forms of weight ${\bf{k}}$ and level $\mathfrak{m} \subset \mathcal{O}\_F$ on $B$. Write $\mathfrak{d} =\operatorname{disc}(B)$. The space $S\_{\bf{k}}(\mathfrak{m})$ comes equipped with actions of the standard Hecke operators $T\_v$ for all primes $v \nmid \mathfrak{m}\mathfrak{d}$, and with Atkin-Lehner involutions for all prime powers $v^e \mid \mathfrak{m}\mathfrak{d}$. The Jacquet-Langlands correspondence induces a "Hecke equivariant" isomorphism of spaces \begin{align\*} S^B\_{\bf{k}}(\mathfrak{m}) &\cong S\_{\bf{k}}(\mathfrak{m}\mathfrak{d})^{\operatorname{\mathfrak{d}-new}}, \end{align\*} where $S\_{\bf{k}}(\mathfrak{m}\mathfrak{d})^{\operatorname{\mathfrak{d}-new}}$ denotes the space of cuspidal Hilbert modular forms of weight ${\bf{k}}$ that are new at primes dividing $\mathfrak{d}$. 


Anyhow, at least when we assume ${\bf{k}} = (2, \ldots, 2)$, a standard argument shows that there is a $G({\bf{A}}\_f)$-equivariant isomorphism $\Gamma(\omega) \cong S^B\_{\bf{k}}(\mathfrak{m})$, where $\omega$ is the sheaf of homomorphic $1$-forms on the complex Shimura curve \begin{align\*} M(\bf{C}) &= G({\bf{Q}}) \backslash G({\bf{A}}\_f) \times X/H.\end{align\*} Here, $X = {\bf{C}} - {\bf{R}}$, and $H \subset G({\bf{A}}\_f)$ is a compact open subgroup of level $\mathfrak{m}$. Let $M$ denote Shimura's canonical model of this curve (defined over $F$). Let $J$ denote the Jacobian of $M$. Let ${\bf{T}}$ denote the subalgebra of $\operatorname{End}(J)$ generated by Hecke correspondences on $M$. My question is whether or not the following construction can or has been made rigorous. Namely, in the setup above, start with a Hilbert modular eigenform ${\bf{f}} \in \pi$, and consider an associated quaternionic eigenform $\Phi \in \pi'$. Viewing $\Phi$ as an eigenform for the Hecke algebra ${\bf{T}}$, consider the homomorphism $\theta\_{\Phi}:{\bf{T}} \longrightarrow E$ that sends a Hecke operator acting on $\Phi$ to its corresponding eigenvalue. Here, $E = E\_{\Phi}$ denotes the extension of ${\bf{Q}}$ generated by all of the eigenvalues of $\Phi$. Let $I\_{\Phi} = \ker{\theta\_{\Phi}}$. Consider the quotient \begin{align\*} A &= J/I\_{\Phi}J. \end{align\*} Is $A$ not an abelian variety associated to the Hilbert modular eigenform ${\bf{f}}$? Or is this completely trivial, with the subtle part being the task of showing that $\dim(A) = [E: {\bf{Q}}]$? 


A more naive question to ask is why Shimura's construction cannot be generalized
directly for a cuspidal Hilbert modular form ${\bf{f}} \in S\_{\bf{k}}(\mathfrak{m})$. Also, how does taking weight ${\bf{k}} = {\bf{2}}$ make the problem simpler? Apologies if parts of this question were somewhat vague, I have sketched matters for simplicity/space. 



Construction of abelian varieties from Hilbert modular forms?
There is no problem with constructing an abelian variety $A$ for *most* Hilbert modular forms of parallel weight $2$, the issue is finding such a variety for *all* $\pi$. In particular, when $d = [K:\mathbf{Q}]$ is even, there is a local obstruction to the existence of a corresponding Shimura curve which realizes the Galois representation associated to $\pi$.
In particular, if $\pi$ has "level one", then no such Shimura curve exists.
 To construct the Galois representation in this case one has to use congruences; this was done by Taylor in the late 80's. 
This issue is also discussed here:


[Are there motives which do not, or should not, show up in the cohomology of any Shimura variety?](https://mathoverflow.net/questions/39485/are-there-motives-which-do-not-or-should-not-show-up-in-the-cohomology-of-any-s)


