\documentclass{SciPost} % Prevent all line breaks in inline equations. \binoppenalty=10000 \relpenalty=10000 \usepackage[utf8]{inputenc} \usepackage[T1]{fontenc} \usepackage{amsmath,latexsym,graphicx} \usepackage[bitstream-charter]{mathdesign} \usepackage[dvipsnames]{xcolor} \usepackage{anyfontsize,authblk} \usepackage{xfrac} % sfrac \urlstyle{sf} \fancypagestyle{SPstyle}{ \fancyhf{} \lhead{\colorbox{scipostblue}{\bf \color{white} ~SciPost Physics }} \rhead{{\bf \color{scipostdeepblue} ~Submission }} \renewcommand{\headrulewidth}{1pt} \fancyfoot[C]{\textbf{\thepage}} } % Fix \cal and \mathcal characters look (so it's not the same as \mathscr) \DeclareSymbolFont{usualmathcal}{OMS}{cmsy}{m}{n} \DeclareSymbolFontAlphabet{\mathcal}{usualmathcal} \hypersetup{ colorlinks, linkcolor={red!50!black}, citecolor={blue!50!black}, urlcolor={blue!80!black} } \author{\footnote{\url{jaron.kent-dobias@roma1.infn.it}}} \affil{Istituto Nazionale di Fisica Nucleare, Sezione di Roma I, Italy} \begin{document} \pagestyle{SPstyle} \begin{center}{\Large \textbf{\color{scipostdeepblue}{ On the topology of solutions to random continuous constraint satisfaction problems\\ }}}\end{center} \begin{center} \textbf{Jaron Kent-Dobias$^\star$} \end{center} \begin{center} Istituto Nazionale di Fisica Nucleare, Sezione di Roma I, Italy \\[\baselineskip] $\star$ \href{mailto:jaron.kent-dobias@roma1.infn.it}{\small jaron.kent-dobias@roma1.infn.it} \end{center} \section*{\color{scipostdeepblue}{Abstract}} \textbf{\boldmath{% We consider the set of solutions to $M$ random polynomial equations whose $N$ variables are restricted to the $(N-1)$-sphere. Each equation has independent Gaussian coefficients and a target value $V_0$. When solutions exist, they form a manifold. We compute the average Euler characteristic of this manifold in the limit of large $N$, and find different behavior depending on the target value $V_0$, the ratio $\alpha=M/N$, and the variances of the coefficients. We divide this behavior into five phases with different implications for the topology of the solution manifold. When $M=1$ there is a correspondence between this problem and level sets of the energy in the spherical spin glasses. We conjecture that the transition energy dividing two of the topological phases corresponds to the asymptotic limit of gradient descent from a random initial condition, possibly resolving a recent open problem in out-of-equilibrium dynamics. } } \vspace{\baselineskip} %%%%%%%%%% BLOCK: Copyright information % This block will be filled during the proof stage, and finilized just before publication. % It exists here only as a placeholder, and should not be modified by authors. \noindent\textcolor{white!90!black}{% \fbox{\parbox{0.975\linewidth}{% \textcolor{white!40!black}{\begin{tabular}{lr}% \begin{minipage}{0.6\textwidth}% {\small Copyright attribution to authors. \newline This work is a submission to SciPost Physics. \newline License information to appear upon publication. \newline Publication information to appear upon publication.} \end{minipage} & \begin{minipage}{0.4\textwidth} {\small Received Date \newline Accepted Date \newline Published Date}% \end{minipage} \end{tabular}} }} } %%%%%%%%%% BLOCK: Copyright information %%%%%%%%%% TODO: LINENO % For convenience during refereeing we turn on line numbers: %\linenumbers % You should run LaTeX twice in order for the line numbers to appear. %%%%%%%%%% END TODO: LINENO %%%%%%%%%% TODO: TOC % Guideline: if your paper is longer that 6 pages, include a TOC % To remove the TOC, simply cut the following block \vspace{10pt} \noindent\rule{\textwidth}{1pt} \tableofcontents \noindent\rule{\textwidth}{1pt} \vspace{10pt} %%%%%%%%%% END TODO: TOC \section{Introduction} Constraint satisfaction problems seek configurations that simultaneously satisfy a set of equations, and form a basis for thinking about problems as diverse as neural networks \cite{Mezard_2009_Constraint}, granular materials \cite{Franz_2017_Universality}, ecosystems \cite{Altieri_2019_Constraint}, and confluent tissues \cite{Urbani_2023_A}. All but the last of these examples deal with sets of inequalities, while the last considers a set of equality constraints. Inequality constraints are familiar in situations like zero-cost solutions in neural networks with ReLu activations and stable equilibrium in the forces between physical objects. Equality constraints naturally appear in the zero-gradient solutions to overparameterized smooth neural networks and in vertex models of tissues. In such problems, there is great interest in characterizing structure in the set of solutions, which can be influential in how algorithms behave when trying to solve them \cite{Baldassi_2016_Unreasonable, Baldassi_2019_Properties, Beneventano_2023_On}. Here, we show how topological information about the set of solutions can be calculated in a simple model of satisfying random nonlinear equalities. This allows us to reason about the connectivity of this solution set. The topological properties revealed by this calculation yield surprising results for the well-studied spherical spin glasses, where a topological transition thought to occur at a threshold energy $E_\text{th}$ where marginal minima are dominant is shown to occur at a different energy $E_\text{sh}$. We conjecture that this difference resolves an outstanding problem in gradient descent dynamics in these systems. We consider the problem of finding configurations $\mathbf x\in\mathbb R^N$ lying on the $(N-1)$-sphere $\|\mathbf x\|^2=N$ that simultaneously satisfy $M$ nonlinear constraints $V_k(\mathbf x)=V_0$ for $1\leq k\leq M$ and some constant $V_0\in\mathbb R$. The nonlinear constraints are taken to be centered Gaussian random functions with covariance \begin{equation} \label{eq:covariance} \overline{V_i(\mathbf x)V_j(\mathbf x')} =\delta_{ij}f\left(\frac{\mathbf x\cdot\mathbf x'}N\right) \end{equation} for some choice of function $f$. When the covariance function $f$ is polynomial, the $V_k$ are also polynomial, with a term of degree $p$ in $f$ corresponding to all possible terms of degree $p$ in $V_k$. In particular, one can explicitly construct functions that satisfy \eqref{eq:covariance} by taking \begin{equation} V_k(\mathbf x) =\sum_{p=0}^\infty\frac1{p!}\sqrt{\frac{f^{(p)}(0)}{N^p}} \sum_{i_1\cdots i_p}^NJ^{(k,p)}_{i_1\cdots i_p}x_{i_1}\cdots x_{i_p} \end{equation} with the elements of the tensors $J^{(k,p)}$ as independently distributed unit normal random variables. The size of the series coefficients of $f$ therefore control the variances in the coefficients of the random polynomial constraints. When $M=1$, this problem corresponds to the level set of a spherical spin glass with energy density $E=V_0/\sqrt{N}$. This problem or small variations thereof have attracted attention recently for their resemblance to encryption, least-squares optimization, and vertex models of confluent tissues \cite{Fyodorov_2019_A, Fyodorov_2020_Counting, Fyodorov_2022_Optimization, Tublin_2022_A, Vivo_2024_Random, Urbani_2023_A, Kamali_2023_Dynamical, Kamali_2023_Stochastic, Urbani_2024_Statistical, Montanari_2023_Solving, Montanari_2024_On, Kent-Dobias_2024_Conditioning, Kent-Dobias_2024_Algorithm-independent}. In each of these cases, the authors studied properties of the cost function \begin{equation} \label{eq:cost} \mathscr C(\mathbf x)=\frac12\sum_{k=1}^M\big[V_k(\mathbf x)-V_0\big]^2 \end{equation} which achieves zero only for configurations that satisfy all the constraints. Here we dispense with the cost function and study the set of solutions directly. This set can be written as \begin{equation} \Omega=\big\{\mathbf x\in\mathbb R^N\mid \|\mathbf x\|^2=N,V_k(\mathbf x)=V_0 \;\forall\;k=1,\ldots,M\big\} \end{equation} Because the constraints are all smooth functions, $\Omega$ is almost always a manifold without singular points.\footnote{The conditions for a singular point are that $0=\frac\partial{\partial\mathbf x}V_k(\mathbf x)$ for all $k$. This is equivalent to asking that the constraints $V_k$ all have a stationary point at the same place. When the $V_k$ are independent and random, this is vanishingly unlikely, requiring $NM+1$ independent equations to be simultaneously satisfied. This means that different connected components of the set of solutions do not intersect, nor are there self-intersections, without extraordinary fine-tuning.} We study the topology of the manifold $\Omega$ by computing its average Euler characteristic, a topological invariant whose value puts constraints on the structure of the manifold. The topological phases determined by this means are distinguished by the size and sign of the Euler characteristic, and the distribution in space of its constituent parts. \section{The average Euler characteristic} \subsection{Definition and derivation} The Euler characteristic $\chi$ of a manifold is a topological invariant \cite{Hatcher_2002_Algebraic}. It is perhaps most familiar in the context of connected compact orientable surfaces, where it characterizes the number of handles in the surface: $\chi=2(1-\#)$ for $\#$ handles. For general $d$, the Euler characteristic of the $d$-sphere is $2$ if $d$ is even and 0 if $d$ is odd. The canonical method for computing the Euler characteristic is done by defining a complex on the manifold in question, essentially a higher-dimensional generalization of a polygonal tiling. Then $\chi$ is given by an alternating sum over the number of cells of increasing dimension, which for 2-manifolds corresponds to the number of vertices, minus the number of edges, plus the number of faces. Morse theory offers another way to compute the Euler characteristic of a manifold $\Omega$ using the statistics of stationary points in a function $H:\Omega\to\mathbb R$ \cite{Audin_2014_Morse}. For functions $H$ without any symmetries with respect to the manifold, the surfaces of gradient flow between adjacent stationary points form a complex. The alternating sum over cells to compute $\chi$ becomes an alternating sum over the count of stationary points of $H$ with increasing index, or \begin{equation} \chi(\Omega)=\sum_{i=0}^N(-1)^i\mathcal N_H(\text{index}=i) \end{equation} Conveniently, we can express this sum as an integral over the manifold using a small variation on the Kac--Rice formula for counting stationary points \cite{Kac_1943_On, Rice_1939_The}. Since the sign of the determinant of the Hessian matrix of $H$ at a stationary point is equal to its index, if we count stationary points including the sign of the determinant, we arrive at the Euler characteristic, or \begin{equation} \label{eq:kac-rice} \chi(\Omega)=\int_\Omega d\mathbf x\,\delta\big(\nabla H(\mathbf x)\big)\det\operatorname{Hess}H(\mathbf x) \end{equation} When the Kac--Rice formula is used to \emph{count} stationary points, one must take pains to preserve the sign of the determinant \cite{Fyodorov_2004_Complexity}. Here we are correct to exclude it. We need to choose a function $H$ for our calculation. Because $\chi$ is a topological invariant, any choice will work so long as it does not share some symmetry with the underlying manifold, i.e., that $H$ satisfies the Smale condition. Because our manifold of random constraints has no symmetries, we can take a simple height function $H(\mathbf x)=\mathbf x_0\cdot\mathbf x$ for some $\mathbf x_0\in\mathbb R^N$ with $\|\mathbf x_0\|^2=N$. $H$ is a height function because when $\mathbf x_0$ is used as the polar axis, $H$ gives the height on the sphere relative to the equator. We treat the integral over the implicitly defined manifold $\Omega$ using the method of Lagrange multipliers. We introduce one multiplier $\omega_0$ to enforce the spherical constraint and $M$ multipliers $\omega_k$ to enforce the vanishing of each of the $V_k$, resulting in the Lagrangian \begin{equation} \label{eq:lagrangian} L(\mathbf x,\pmb\omega) =H(\mathbf x)+\frac12\omega_0\big(\|\mathbf x\|^2-N\big) +\sum_{k=1}^M\omega_k\big(V_k(\mathbf x)-V_0\big) \end{equation} The integral over $\Omega$ in \eqref{eq:kac-rice} then becomes \begin{equation} \label{eq:kac-rice.lagrange} \chi(\Omega)=\int_{\mathbb R^N} d\mathbf x\int_{\mathbb R^{M+1}}d\pmb\omega \,\delta\big(\partial L(\mathbf x,\pmb\omega)\big) \det\partial\partial L(\mathbf x,\pmb\omega) \end{equation} where $\partial=[\frac\partial{\partial\mathbf x},\frac\partial{\partial\pmb\omega}]$ is the vector of partial derivatives with respect to all $N+M+1$ variables. This integral is now in a form where standard techniques from mean-field theory can be applied to calculate it. To evaluate the average of $\chi$ over the constraints, we first translate the $\delta$-functions and determinant to integral form, with \begin{align} \label{eq:delta.exp} \delta\big(\partial L(\mathbf x,\pmb\omega)\big) &=\int\frac{d\hat{\mathbf x}}{(2\pi)^N}\frac{d\hat{\pmb\omega}}{(2\pi)^{M+1}} e^{i[\hat{\mathbf x},\hat{\pmb\omega}]\cdot\partial L(\mathbf x,\pmb\omega)} \\ \label{eq:det.exp} \det\partial\partial L(\mathbf x,\pmb\omega) &=\int d\bar{\pmb\eta}\,d\pmb\eta\,d\bar{\pmb\gamma}\,d\pmb\gamma\, e^{-[\bar{\pmb\eta},\bar{\pmb\gamma}]^T\partial\partial L(\mathbf x,\pmb\omega)[\pmb\eta,\pmb\gamma]} \end{align} where $\hat{\mathbf x}$ and $\hat{\pmb\omega}$ are ordinary vectors and $\bar{\pmb\eta}$, $\pmb\eta$, $\bar{\pmb\gamma}$, and $\pmb\gamma$ are Grassmann vectors. With these expressions substituted into \eqref{eq:kac-rice.lagrange}, the result is an integral over an exponential whose argument is linear in the random functions $V_k$. These functions can therefore be averaged over, and the resulting expression treated with standard methods. Details of this calculation can be found in Appendix~\ref{sec:euler}. The result is the reduction of the average Euler characteristic to an expression of the form \begin{equation} \label{eq:pre-saddle.characteristic} \overline{\chi(\Omega)} =\left(\frac N{2\pi}\right)^2\int dR\,dD\,dm\,d\hat m\,g(R,D,m,\hat m)\,e^{N\mathcal S_\chi(R,D,m,\hat m)} \end{equation} where $g$ is a prefactor of $o(N^0)$, and $\mathcal S_\chi$ is an effective action defined by \begin{equation} \label{eq:euler.action} \begin{aligned} \mathcal S_\chi(R,D,m,\hat m\mid\alpha,V_0) &=-\hat m-\frac\alpha2\left[ \log\left(1+\frac{f(1)D}{f'(1)R^2}\right) +\frac{V_0^2}{f(1)}\left(1+\frac{f'(1)R^2}{f(1)D}\right)^{-1} \right] \\ &\hspace{7em}+\frac12\log\left( 1+\frac{(1-m^2)D+\hat m^2-2Rm\hat m}{R^2} \right) \end{aligned} \end{equation} The remaining order parameters are defined by the scalar products \begin{align} R=-i\frac1N\mathbf x\cdot\hat{\mathbf x} && D=\frac1N\hat{\mathbf x}\cdot\hat{\mathbf x} && m=\frac1N\mathbf x\cdot\mathbf x_0 && \hat m=-i\frac1N\hat {\mathbf x}\cdot\mathbf x_0 \end{align} \subsection{Features of the effective action} This integral can be evaluated to leading order by a saddle point method. For reasons we will see, it is best to extremize with respect to $R$, $D$, and $\hat m$, leaving a new effective action of $m$ alone. This can be solved to give \begin{equation} D=-\frac{m+R_*}{1-m^2}R_* \qquad \hat m=0 \end{equation} \begin{equation} \label{eq:rs} \begin{aligned} R_* =\frac{-m(1-m^2)}{2[f(1)-(1-m^2)f'(1)]^2} \Bigg[ \alpha V_0^2f'(1) +(2-\alpha)f(1)\left(\frac{f(1)}{1-m^2}-f'(1)\right) \quad \\ \quad+\alpha\sqrt{ \tfrac{4V_0^2}\alpha f(1)f'(1)\left[\tfrac{f(1)}{1-m^2}-f'(1)\right] +\left[\tfrac{f(1)^2}{1-m^2}-\big(V_0^2+f(1)\big)f'(1)\right]^2 } \Bigg] \end{aligned} \end{equation} with the resulting effective action as a function of $m$ alone given by \begin{equation} \label{eq:S.m} \mathcal S_\chi(m) =-\frac\alpha2\bigg[ \log\left( 1-\frac{f(1)}{f'(1)}\frac{1+\frac m{R_*}}{1-m^2} \right) +\frac{V_0^2}{f(1)}\left( 1-\frac{f'(1)}{f(1)}\frac{1-m^2}{1+\frac m{R_*}} \right)^{-1} \bigg] +\frac12\log\left(-\frac m{R_*}\right) \end{equation} This function is plotted as a function of $m$ in Fig.~\ref{fig:action} for a variety of $V_0$ and $f$. To finish evaluating the integral, this expression should be maximized with respect to $m$. If $m_*$ is such a maximum, then $\overline{\chi(\Omega)}\propto e^{N\mathcal S_\chi(m_*)}$. The order parameter $m$ is the overlap of the configuration $\mathbf x$ with the height axis $\mathbf x_0$. Therefore, the value $m$ that maximizes this action can be understood as the latitude on the sphere where most of the contribution to the Euler characteristic is made. \begin{figure} \includegraphics{figs/action_1.pdf} \hspace{-3.5em} \includegraphics{figs/action_3.pdf} \caption{ \textbf{Effective action for the Euler characteristic.} The effective action \eqref{eq:S.m} governing the average Euler characteristic as a function of the overlap $m=\frac1N\mathbf x\cdot\mathbf x_0$ with the height axis for two different homogeneous polynomial constraints and a variety of target values $V_0$. Dashed lines depict $\operatorname{Re}\mathcal S_\chi$ when its imaginary part is nonzero. In both plots $\alpha=\frac12$. \textbf{Left:} With linear functions there are two regimes. For small $V_0$, there are maxima at $m=\pm m^*$ where the action is zero, while after the satisfiability transition at $V_0=V_{\text{\textsc{sat}}\ast}=1$, $m_*$ goes to zero and the action becomes negative everywhere. \textbf{Right:} With nonlinear functions there are other possible regimes. For small $V_0$, there are maxima at $m=\pm m^*$ where the action is zero but the real part of the action is maximized at $m=0$ where the action is complex. For larger $V_0\geq V_\text{on}\simeq1.099$ the maxima at $m=\pm m^*$ disappear. For $V_0\geq V_\text{sh}\simeq1.394$ larger still, the action becomes real everywhere. Finally, at a satisfiability transition $V_0=V_\text{\textsc{sat}}\simeq1.440$ the action becomes negative everywhere. } \label{fig:action} \end{figure} The action $\mathcal S_\chi$ is extremized with respect to $m$ at $m=0$ or $m=\pm m_*=\mp R_*(m_*)$ for \begin{equation} m^*=\sqrt{1-\frac{\alpha}{f'(1)}\big(V_0^2+f(1)\big)} \end{equation} and $\mathcal S_\chi(m^*)=0$. Zero action implies that $\overline{\chi(\Omega)}$ does not vary exponentially with $N$, and in fact we show in Appendix~\ref{sec:prefactor} that the contribution from each of these maxima is $(-1)^{N-M-1}+o(N^0)$, so that their sum is $2$ in even dimensions and $0$ in odd dimensions. This result is consistent with the topology of an $N-M-1$ sphere. If this solution were always well-defined, it would vanish when the argument of the square root vanishes at \begin{equation} V_0^2>V_{\text{\textsc{sat}}\ast}^2\equiv\frac{f'(1)}\alpha-f(1) \end{equation} This corresponds precisely to the satisfiability transition found in previous work by a replica symmetric analysis of the cost function \eqref{eq:cost} \cite{Fyodorov_2019_A, Fyodorov_2020_Counting, Fyodorov_2022_Optimization, Tublin_2022_A, Vivo_2024_Random}. However, the action becomes complex in the region $m^2V_\text{on}^2\equiv\frac{f(1)}\alpha\left(1-\alpha+\sqrt{1-\alpha}\right) \end{equation} Comparing this with the satisfiability transition associated with $m_*$ going to zero, one sees \begin{equation} V_\text{on}^2-V_{\text{\textsc{sat}}\ast}^2 =\frac1\alpha\left(f'(1)-f(1)-f(1)\sqrt{1-\alpha}\right) \end{equation} If $f(q)$ is purely linear, then $f'(1)=f(1)$ and $V_\text{on}^2>V_{\text{\textsc{sat}}\ast}^2$, so the naïve satisfiability transition happens first. On the other hand, when $f(q)$ contains powers of $q$ strictly greater than 1, then $f'(1)\geq 2f(1)$ and $V_\text{on}^2\leq V_{\text{\textsc{sat}}\ast}^2$, so the onset happens first. In situations with mixed constant, linear, and nonlinear terms in $f$, the order of the transitions depends on the precise form of $f$. Likewise, the solution at $m=0$ is sometimes complex-valued and sometimes real-valued. For $V_0$ less than a shattering value $V_\text{sh}$ defined by \begin{equation} V_0^20$, the solution at $m=0$ is difficult to interpret, since the action takes a complex value. In fact, it is not clear what the contribution to the average value of the Euler characteristic should be at all when there is some range $-m_\text{min}0$, and $\overline{\chi(\Omega)^2}\neq[\overline{\chi(\Omega)}]^2$ always. }we find three saddle points that could contribute to the value of $\overline{\chi(\Omega)^2}$: two at $\pm m^*$ where $\frac1N\log\overline{\chi(\Omega)^2}=\frac1N\log\overline{\chi(\Omega)}\simeq0$, and one at $m=0$ where \begin{equation} \frac1N\log\overline{\chi(\Omega)^2}=2\operatorname{Re}\mathcal S_\chi(0) \end{equation} which is consistent with $\overline{\chi(\Omega)^2}\simeq[\overline{\chi(\Omega)}]^2$. It is therefore possible to interpret the average Euler characteristic in the regime where its effective action is complex-valued as being negative, with a magnitude implied by the real part of the action. Such a correspondence, which indicates that the `annealed' calculation here is also representative of typical realizations of the constraints, is not always true. With average squared Euler characteristic we find instabilities of the solution at $m=0$ to replica symmetry breaking (\textsc{rsb}). We do not explore these \textsc{rsb} solutions here, except in the context of $M=1$ in Section~\ref{sec:ssg}. However, in the following Figures \ref{fig:phases} and \ref{fig:crossover} we shade the unstable region. \subsection{Topological phases and their interpretation} The results of the previous section allow us to unambiguously define distinct topological phases, which differ depending on the presence or absence of the local maxima at $m=\pm m^*$, on the presence or absence of the local maximum at $m=0$, on the real or complex nature of this maximum, and finally on whether the action is positive or negative. Below we enumerate these regimes, which are schematically represented in Fig.~\ref{fig:cartoons}.\footnote{ In the following we characterize regimes by values of $\overline{\chi(\Omega)}$. These should be understood as their values in \emph{even} dimensions, since in odd dimensions the Euler characteristic is always identically zero. We do not expect the qualitative results to change depending on the evenness or oddness of the manifold dimension. } \paragraph{Regime I: \boldmath{$\overline{\chi(\Omega)}=2$}.} This regime is found when the magnitude of the target value $V_0$ is less than the onset $V_\text{on}$ and $\operatorname{Re}\mathcal S(0)<0$, so that the maxima at $m=\pm m^*$ exist and are the dominant contributions to the average Euler characteristic. Here, $\overline{\chi(\Omega)}=2+o(1)$ for even $N-M-1$, strongly indicating a topology homeomorphic to the $S^{N-M-1}$ sphere. This regime is the only nontrivial one found with linear covariance $f(q)$, where the solution manifold must be a sphere if it is not empty. \paragraph{Regime II: \boldmath{$\overline{\chi(\Omega)}$} large and negative, isolated contributions at \boldmath{$m=\pm m^*$}.} This regime is found when the magnitude of the target value $V_0$ is less than the onset $V_\text{on}$, $\operatorname{Re}\mathcal S(0)>0$, and the value of the action at $m=0$ is complex. The dominant contribution to the average Euler characteristic comes from the equator at $m=0$, but the complexity of the action implies that the Euler characteristic is negative. While the topology of the manifold is not necessarily connected in this regime, holes are more numerous than components. Since $V_0^2V_\text{on}^2$. The solutions at $m=\pm m_*$ no longer exist, and nontrivial contributions to the Euler characteristic are made all the way to the solution manifold's boundary. \paragraph{Regime IV: \boldmath{$\overline{\chi(\Omega)}$} large and positive.} This regime is found when the magnitude of the target value $V_0$ is greater than the shattering value $V_\text{sh}$ and $\mathcal S(0)>0$. Above the shattering transition the effective action is real everywhere, and its value at the equator is the dominant contribution. Large connected components of the manifold may or may not exist, but small disconnected components outnumber holes. \paragraph{Regime V: \boldmath{$\overline{\chi(\Omega)}$} very small.} Here $\frac1N\log\overline{\chi(\Omega)}<0$, indicating that the average Euler characteristic shrinks exponentially with $N$. Under most conditions we conclude this is the \textsc{unsat} regime where no manifold exists, but there may be circumstances where part of this regime is characterized by nonempty solution manifolds that are overwhelmingly likely to have Euler characteristic zero. \begin{figure} \includegraphics[width=0.196\textwidth]{figs/connected.pdf} \includegraphics[width=0.196\textwidth]{figs/middle.pdf} \includegraphics[width=0.196\textwidth]{figs/complex.pdf} \includegraphics[width=0.196\textwidth]{figs/shattered.pdf} \includegraphics[width=0.196\textwidth]{figs/gone.pdf} \hspace{1.5em} \textbf{Regime I} \hfill \textbf{Regime II} \hfill \textbf{Regime III} \hfill \textbf{Regime IV} \hfill \textbf{Regime V} \hspace{1.5em} \caption{ \textbf{Cartoons of the solution manifold in five topological regimes.} The solution manifold is shown as a shaded region with a black boundary, and the height axis $\mathbf x_0$ is a black arrow. In Regime I, the statistics of the Euler characteristic is consistent with a manifold with a single simply-connected component. In Regime II, holes occupy the equator but its most polar regions are topologically simple. In Regime III, holes dominate and the edge of the manifold is not necessarily simple. In Regime IV, disconnected components dominate. In Regime V, the manifold is empty. } \label{fig:cartoons} \end{figure} \begin{figure} \includegraphics{figs/phases_1.pdf} \hspace{-3em} \includegraphics{figs/phases_2.pdf} \hspace{-3em} \includegraphics{figs/phases_3.pdf} \caption{ \textbf{Topological phase diagram.} Topological phases of the model for three different homogeneous covariance functions. The regimes are defined in the text and depicted as cartoons in Fig.~\ref{fig:cartoons}. The shaded region in the center panel shows where these results are unstable to \textsc{rsb}. In the limit of $\alpha\to0$, the behavior of level sets of the spherical spin glasses are recovered: the righthand plot shows how the ground state energy $E_\text{gs}$ and threshold energy $E_\text{th}$ of the 3-spin spherical model correspond with the limits of the satisfiability and shattering transitions in the pure cubic model. Note that for mixed models with inhomogeneous covariance functions, $E_\text{th}$ is not the lower limit of $V_\text{sh}$. } \label{fig:phases} \end{figure} \paragraph{} The distribution of these phases for situations with homogeneous polynomial constraint functions is shown in Fig.~\ref{fig:phases}. For purely linear models, the only two regimes are I and V, separated by a satisfiability transition at $V_{\text{\textsc{sat}}\ast}$. This is expected: the intersection of a plane and a sphere is another sphere, and therefore a model of linear constraints in a spherical configuration space can only produce a solution manifold consisting of a single sphere, or the empty set. For purely nonlinear models, regime I does not appear, while the other three nontrivial regimes do. Regimes II and III are separated by the onset transition at $V_\text{on}$, while III and IV are separated by the shattering transition at $V_\text{sh}$. Finally, IV and V are now separated by the satisfiability transition at $V_\text{\textsc{sat}}$. One interesting feature occurs in the limit of $\alpha$ to zero. If $V_0$ is likewise rescaled in the correct way, the limit of these phase boundaries approaches known landmark energy values in the pure spherical spin glasses. In particular, the limit to zero $\alpha$ of the scaled satisfiability transition $V_\text{\textsc{sat}}\sqrt\alpha$ approaches the ground state energy $E_\text{gs}$, while the limit to zero $\alpha$ of the scaled shattering transition $V_\text{sh}\sqrt\alpha$ approaches the threshold energy $E_\text{th}$. The correspondence between ground state and satisfiability is expected: when the energy of a level set is greater in magnitude than the ground state, the level set will usually be empty. The correspondence between the threshold and shattering energies is also intuitive, since the threshold energy is typically understood as the point where the landscape fractures into pieces. However, this second correspondence is only true for the pure spherical models with homogeneous $f(q)$. For any other model with an inhomogeneous $f(q)$, $E_\text{sh}^2V_\text{\textsc{rsb}}^2 \equiv\frac{[f(1)-f(0)]^2}{\alpha f''(0)} -f(0)-\frac{f'(0)}{f''(0)} \end{equation} We conjecture that the \textsc{rsb} instability found in \cite{Urbani_2023_A} is a trait of the cost function \eqref{eq:cost}, and is not inherent to the structure of the solution manifold. Perhaps the best evidence for this is to consider the limit of $M=1$, or $\alpha\to0$ with $E=V_0\sqrt\alpha$ held fixed, where this problem reduces to the level sets of the spherical spin glasses. The instability \eqref{eq:vrsb} implies for the pure spherical 2-spin model with $f(q)=\frac12q^2$ that $E_\textsc{rsb}=\frac12$, though nothing of note is known to occur in the level sets of 2-spin model at such an energy. \section{The quenched shattering energy} \label{sec:1frsb} Here we share how the quenched shattering energy is calculated under a {\oldstylenums1}\textsc{frsb} ansatz. To best make contact with prior work on the spherical spin glasses, we start with \eqref{eq:χ.post-average}. The formula in a quenched calculation is almost the same as that for the annealed, but the order parameters $C$, $R$, $D$, and $G$ must be understood as $n\times n$ matrices rather than scalars. In principle $m$, $\hat m$, $\omega_0$, $\hat\omega_0$, $\omega_1$, and $\hat\omega_1$ should be considered $n$-dimensional vectors, but since in our ansatz replica vectors are constant we can take them to be constant from the start. We have \begin{align} &\overline{\log\chi(\Omega)} =\lim_{n\to0}\frac\partial{\partial n}\int dC\,dR\,dD\,dG\,dm\,d\hat m\,d\omega_0\,d\hat\omega_0\,d\omega_1\,d\hat\omega_1\, \exp N\Bigg\{ n\hat m +\frac i2\hat\omega_0\operatorname{Tr}(C-I) \notag \\ &\hspace{2em}-\omega_0\operatorname{Tr}(G+R) -in\hat\omega_1E_0 +\frac12\log\det\begin{bmatrix} C-m^2 & i(R-m\hat m) \\ i(R-m\hat m) & D-\hat m^2 \end{bmatrix} -\frac12\log G^2 \notag \\ &\hspace{2em}-\frac12\sum_{ab}^n\left[ \hat\omega_1^2f(C_{ab}) +(2i\omega_1\hat\omega_1R_{ab}+\omega_1^2D_{ab})f'(C_{ab}) +\omega_1^2(G_{ab}^2-R_{ab}^2)f''(C_{ab}) \right] \Bigg\} \end{align} which is completely general for the spherical spin glasses with $M=1$. We now make a series of simplifications. Ward identities associated with the BRST symmetry possessed by the original action \cite{Annibale_2003_The, Annibale_2003_Supersymmetric, Annibale_2004_Coexistence} indicate that \begin{align} \omega_1D=-i\hat\omega_1R && G=-R && \hat m=0 \end{align} Moreover, this problem with $m=0$ has a close resemblance to the complexity of the spherical spin glasses. In both, at the supersymmetric saddle point the matrix $R$ is diagonal with $R=r_dI$ \cite{Kent-Dobias_2023_How}. To investigate the shattering energy, we can restrict to solutions with $m=0$ and look for the place where such solutions vanish. Inserting these simplifications, we have up to highest order in $N$ \begin{equation} \begin{aligned} \overline{\log\chi(\Omega)} =\lim_{n\to0}\frac\partial{\partial n}\int dC\,dR\,d\hat\omega_0\,d\omega_1\,d\hat\omega_1\, \exp N\Bigg\{ \frac i2\hat\omega_0\operatorname{Tr}(C-I) -in\hat\omega_1E \qquad\\ -i\frac12n\omega_1\hat\omega_1r_df'(1) -\frac12\sum_{ab}^n \hat\omega_1^2f(C_{ab}) +\frac12\log\det \left(\frac{-i\hat\omega_1}{\omega_1r_d}C+I\right) \Bigg\} \end{aligned} \end{equation} If we redefine $\hat\beta=-i\hat\omega_1$ and $\tilde r_d=\omega_1 r_d$, we find \begin{equation} \begin{aligned} \overline{\log\chi(\Omega)} =\lim_{n\to0}\frac\partial{\partial n}\int dC\,d\hat\beta\,d\tilde r_d\,\hat\omega_0\, \exp N\Bigg\{ \frac i2\hat\omega_0\operatorname{Tr}(C-I) +n\hat\beta E \qquad\\ +n\frac12\hat\beta\tilde r_df'(1) +\frac12\sum_{ab}^n \hat\beta^2f(C_{ab}) +\frac12\log\det \left(\frac{\hat\beta}{\tilde r_d}C+I\right) \Bigg\} \end{aligned} \end{equation} which is exactly the effective action for the supersymmetric complexity in the spherical spin glasses when in the regime where minima dominate \cite{Kent-Dobias_2023_How}. As the effective action for the Euler characteristic, this expression is valid whether minima dominate or not. Following the same steps as in \cite{Kent-Dobias_2023_How}, we can write the continuum version of this action for arbitrary \textsc{rsb} structure in the matrix $C$ as \begin{equation} \label{eq:cont.action} \frac1N\overline{\log\chi(\Omega)}=\hat\beta E+\frac12\hat\beta\tilde r_df'(1) +\frac12\int_0^1dq\,\left[ \hat\beta^2f''(q)\chi(q)+\frac1{\chi(q)+\tilde r_d\hat\beta^{-1}} \right] \end{equation} where $\chi(q)=\int_1^qdq'\int_0^{q'}dq''P(q'')$ and $P(q)$ is the distribution of off-diagonal elements of the matrix $C$ \cite{Crisanti_1992_The, Crisanti_2004_Spherical, Crisanti_2006_Spherical}. This action must be extremized over the function $\chi$ and the variables $\hat\beta$ and $\tilde r_d$, under the constraint that $\chi(q)$ is continuous, that it has $\chi'(1)=-1$, and $\chi(1)=0$, necessary for $P$ to be a well-defined probability distribution. Now the specific form of replica symmetry breaking we expect to see is important. We want to study the mixed $2+s$ models in the regime where they may have 1-full \textsc{rsb} in equilibrium \cite{Auffinger_2022_The}. For the Euler characteristic like the complexity, this will correspond to full \textsc{rsb}, in an analogous way to {\oldstylenums1}\textsc{rsb} equilibria give a \textsc{rs} complexity. Such order is characterized by a piecewise smooth $\chi$ of the form \begin{equation} \chi(q)=\begin{cases} \chi_0(q) & q < q_0 \\ 1-q & q \geq q_0 \end{cases} \end{equation} where $\chi_0$ is \begin{equation} \chi_0(q)=\frac1{\hat\beta}[f''(q)^{-1/2}-\tilde r_d] \end{equation} the function implied by extremizing \eqref{eq:cont.action} over $\chi$. The variable $q_0$ must be chosen so that $\chi$ is continuous. The key difference between \textsc{frsb} and {\oldstylenums1}\textsc{frsb} in this setting is that in the former case the ground state has $q_0=1$, while in the latter the ground state has $q_0<1$. We use this action to find the shattering energy in the following way. First, we know that the ground state energy is the place where the manifold and therefore the average Euler characteristic vanishes. Therefore, setting $\overline{\log\chi(\Omega)}=0$ and solving for $E$ yields a formula for the ground state energy \begin{equation} E_\text{gs}=-\frac1{\hat\beta}\left\{ \frac12\hat\beta\tilde r_df'(1) +\frac12\int_0^1dq\,\left[ \hat\beta^2f''(q)\chi(q)+\frac1{\chi(q)+\tilde r_d\hat\beta^{-1}} \right] \right\} \end{equation} This expression can be maximized over $\hat\beta$ and $\tilde r_d$ to find the correct parameters at the ground state for a particular model. Then, the shattering energy is found by slowly lowering $q_0$ and solving the combined extremal and continuity problem for $\hat\beta$, $\tilde r_d$, and $E$ until $E$ reaches a maximum value and starts to decrease. This maximum is the shattering energy, since it is the point where the $m=0$ solution vanishes. Starting from this point, we take small steps in $s$ and $\lambda_s$, again simultaneously extremizing, ensuring continuity, and maximizing $E$. This draws out the shattering energy across the entire range of $s$ plotted in Fig.~\ref{fig:ssg}. The transition to the \textsc{rs} solution occurs when the value $q_0$ that maximizes $E$ hits zero. We find that the transition between \textsc{rs} and \textsc{frsb} is precisely predicted by the \textsc{rsb} instability calculated in Appendix~\ref{sec:rms} by analyzing the solution to the average square of the Euler characteristic, as shown in Fig.~\ref{fig:rsb}. \begin{figure} \centering \includegraphics{figs/rsb_comp.pdf} \caption{ \textbf{Self-consistency between \textsc{rsb} instabilities.} Comparison between the predicted value $q_0$ for the \textsc{frsb} solution at the shattering energy in $2+s$ models and the value of the determinant \eqref{eq:stab.det} used in the previous appendix to predict the point of \textsc{rsb} instability. The value of $s$ at which $q_0$ becomes nonzero is precisely the point where the determinant has a nontrivial zero. } \label{fig:rsb} \end{figure} \bibliography{topology} \end{document}