 Research
 Open Access
 Published:
Technologies for supporting highorder geodesic mesh frameworks for computational astrophysics and space sciences
Computational Astrophysics and Cosmology volume 7, Article number: 1 (2020)
Abstract
Many important problems in astrophysics, space physics, and geophysics involve flows of (possibly ionized) gases in the vicinity of a spherical object, such as a star or planet. The geometry of such a system naturally favors numerical schemes based on a spherical mesh. Despite its orthogonality property, the polar (latitudelongitude) mesh is ill suited for computation because of the singularity on the polar axis, leading to a highly nonuniform distribution of zone sizes. The consequences are (a) loss of accuracy due to large variations in zone aspect ratios, and (b) poor computational efficiency from a severe limitations on the time stepping. Geodesic meshes, based on a central projection using a Platonic solid as a template, solve the anisotropy problem, but increase the complexity of the resulting computer code. We describe a new finite volume implementation of Euler and MHD systems of equations on a triangular geodesic mesh (TGM) that is accurate up to fourth order in space and time and conserves the divergence of magnetic field to machine precision. The paper discusses in detail the generation of a TGM, the domain decomposition techniques, threedimensional conservative reconstruction, and time stepping.
Introduction
Objects in the universe tend to assume a spherical shape owing to the central nature of the gravitational force. Common examples include globular star clusters, stars and stellarlike objects, planets, and the larger planetary satellites. Modeling such objects’ interior, surface, or atmospheric processes is most conveniently done in a spherical coordinate system because it is perfectly adapted to the shape of the object. A threedimensional spherical coordinate system has radial distance from the center of the sphere as one of its coordinates. In a spherical polar coordinate system the two remaining coordinates are the polar angle, or colatitude, and the azimuthal angle. Implementing a computational mesh based on the polar spherical system incurs only a modest increase in algorithmic complexity compared with Cartesian meshes because both meshes are logically orthogonal. Unfortunately, this simplicity comes at a price: spherical polar meshes have a singularity on the polar axis where the planes of constant azimuth converge to a single line. As a result the sizes of the computational zones become progressively smaller toward the poles. A polar mesh therefore provides a very nonuniform coverage of the surface of the sphere, which is a highly undesirable property. Because the time step used in a simulation is proportional to the smallest dimension of the zone, a simulation based on a polar mesh is quite inefficient.
Polar singularities can be avoided by using a composite mesh, consisting of multiple partially overlapping patches of structured mesh, where each patch is singularity free (Phillips 1959; Browning et al. 1989; Kageyama and Sato 2004; Feng et al. 2010; Usmanov et al. 2012). In this approach the different meshes must be synchronized in their regions of overlap, which involves interpolation and could result in a loss of accuracy or conservation. Another approach, first introduced in the work of Sadourny et al. (1968), uses a mesh that covers the surface of the sphere without gaps or overlaps, known as a tesselation. Each “tile” in the tesselatation is a spherical polygon such as a triangle, a quadrilateral, a pentagon, or a hexagon. The lines connecting adjacent vertices on the sphere are usually (but not always) great circle arcs, which are geodesic lines on the sphere (hence the name, “geodesic mesh”). A well chosen tesselation method can provide a nearly uniform coverage of the surface of the sphere which greatly improves computational efficiency.
A geodesic mesh is constructed from a regular polyhedron (Platonic solid) inscribed inside a sphere used as a template. The most common method of generating such a mesh is to project the edges of the polyhedron to the sphere and recursively subdivide each spherical polygon into smaller polygonal faces until the desired level of discretization is achieved. A cube can be used to generate a cubesphere mesh whose faces are quadrilaterals (Ronchi et al. 1996; Koldoba et al. 2002; Choblet et al. 2007; Putman and Lin 2007; Ivan et al. 2015; Ullrich and Taylor 2015). Such a mesh is topologically Cartesian within each of the six faces of the cube, requiring special treatment only in the vicinity of the eight corners. It is also possible to construct a mesh out of triangles using an octahedron (Feng et al. 2007), dodecahedron (Nakamizo et al. 2009), or an icosahedron (Giraldo 1997; Pudykiewicz 2006; Bernard et al. 2009) as the base solid. A variation of this approach uses a hexagon based dual tesselation, obtained by replacing the vertices of the triangular mesh with face circumcenters and vice versa (Heikes and Randall 1995a; Du et al. 2003; Feng et al. 2007; Miura 2007; Florinski et al. 2013).
Non geodesic tesselations also exist; one prominent example being the HEALPix mesh used for numerical analysis of astrophysical data on the sphere (Gorski et al. 2005). For threedimensional problems the tesselation is extruded radially, producing a threedimensional spherical geodesic mesh. A 3D mesh based on a geodesic tesselation has a very useful property that some of its faces (the socalled rfaces, see below) are flat, which greatly simplifies the numerical scheme. By contrast, all faces of nongeodesic meshes are curved, making such meshes less convenient for use with 3D problems.
In this paper we describe a powerful new framework for finite volume simulations on a triangular geodesic mesh (TGM) with second, third, and fourth orders of accuracy. At this time the software is developed to solve MHD problems with up to fourth order of accuracy in space and time, while conserving the divergence of the magnetic field down to machine precision. Several of the underlying numerical algorithms have been previously published and we refer the interested reader to these papers. However, implementation of these algorithms on a geodesic mesh requires a novel perspective. This is because a geodesic mesh possesses properties of both structured and unstructured meshes. A number of innovative techniques need to be brought together in order to efficiently carry out CFD type simulations on TGMs. The goal of this paper is to describe in detail the techniques that enable efficient implementation of MHD algorithms on spherical geodesic meshes.
Mesh construction
The choice of spherical polygons used to tile the sphere consists of triangles, quadrilaterals, and hexagons (with a small mix of pentagons), but not all combinations result in a high quality mesh. It is desirable to have a mesh that is both highly uniform (or isotropic) and nestable. The first property demands that the faces should be approximately of the same shape and size, while the second ensures strict parentchild relationship between the recursive subdivisions, which is a critical property for domain decomposition (and hence efficient parallelization) as well as adaptive refinement. A regular polyhedron is perfectly uniform: the edges are all of equal length, the faces have the same area, and the vertex angles are the same (see the upper left panel in Fig. 1). However, the very first subdivision breaks this perfect symmetry because the four daughter faces are of a slightly different shape and size. For example, in a triangular mesh shown in the lower left panel of Fig. 1 the daughter face in the middle of the parent face is slightly different in size from the three daughter faces at the corners. Consequently, higher division meshes are somewhat less uniform that those at lower division. This departure from uniformity is greatest near the vertices of the base polyhedron. In addition, the uniform connectivity of the mesh is violated near these singular points. As an example, consider a mesh constructed from a base hexahedron with quadrilateral faces (i.e., the cube sphere). While commonly each vertex is shared by four faces, only three meet at the eight singular points. As a result the quadrilaterals adjacent to these vertices are diamond shaped, rather than square.
The mesh described in this paper is constructed from an icosahedron and has triangular shaped faces. The upper right panel in Fig. 1 shows that there are twelve singular points in this mesh, where five triangles meet instead of the usual six, but the anisotropy so introduced is not as prominent because the defects are distributed over a larger number of sites. This is the reason that an icosahedron produces a superior mesh compared to a tetrahedron or an octahedron. A dodecahedron can in principle be used, but it lacks a division 0 triangular tesselation, consisting instead of pentagons, and is less convenient for practical use. A hexagonal mesh like that used by Florinski et al. (2013) has good uniformity, but is not nestable.
Construction of a TGM begins with inscribing an icosahedron inside a sphere (in the rest of this paper we will always assume that the sphere has a unit radius, unless stated otherwise) and centrally projecting its edges to the surface of the sphere, see the top row of Fig. 1. This projection generates a division 0 tesselation that includes 12 vertices, 20 triangular faces, called tfaces and 30 edges, called tedges (these names are chosen to distinguish them from the faces and edges oriented in the radial direction produced by the radial extrusion of the mesh that bear the prefix “r”). For the sake of efficiency, all calculations on the sphere are performed in Cartesian coordinates using vector operations on the vertices. The input to the mesh generator consists of the coordinates of the icosahedron’s vertices, vertexvertex (VV) neighbor information, and facevertex (FV) connectivity information.
At each division, the complete mesh connectivity information is computed and stored. For vertices, this includes the list (VV) of six neighbor vertices (five at division 0), six(five) tedges meeting at the vertex (VE) and six(five) tfaces sharing the vertex (VF). For edges, connectivity information includes the two vertices at the ends (EV) and the two tfaces sharing this tedge (EF). Finally, for faces we compute the list of three vertices at the corners (FV), the list of three edges (FE) and the list of three face neighbors (FF), for the total of eight connectivity tables. Table 1 shows the order of connectivity table generation and the methods used for construction. Note that at division zero the VV and FV information is already available and steps 1 and 3 are therefore omitted. To facilitate search operations FV, FE, FF, and VF lists are ordered in the counterclockwise direction, while the remaining tables are not ordered. None of the steps of the mesh generation process require a full search, and the algorithm is linear in the number of elements.
To produce a division 1 tesselation shown in Fig. 1 (bottomleft) new vertices are inserted at the midpoints of division 0 edges. These vertices are then connected with new edges (great circle arcs) that divide each spherical triangle into four smaller triangles. The process is repeated until the desired level of refinement is achieved. It can be easily verified that the number of vertices, edges, and faces in the tesselation at division d are
It should be pointed out that the mesh construction algorithm described above is not restricted to icosahedral meshes, but can in principle start with any one of the five Platonic solids. Only steps 1 and 3 in Table 1 need to be adjusted. This property permits writing highly modular geodesic mesh generation algorithms for the sphere.
The nonuniformity of the mesh can be assessed by computing the ratios between the largest and the smallest measurement of edge lengths, vertex angles, and face areas. A high quality mesh would have these ratios as close to unity as possible. Table 2 documents the properties of triangular icosahedral tesselations at divisions zero through eight. Note that the ratios quickly converge to their asymptotic values. The largest face is only 30% larger than the smallest face, so the disparity in zone sizes will not noticeably affect the time step. Figure 2 compares the geometric properties of the icosahedral TGM and the hexahedral quadrilateral geodesic mesh (QGM), also known as the gnomonic cube sphere. Shown are the edge, angle, and area largesttosmallest ratios that should be a close to unity as possible. One can see that the icosahedral mesh has superior uniformity of every property compared with the QGM.
The simple mesh does have a few deficiencies, mainly related to the fact that the centroids of the faces are distinct from the circumcenters, as pointed out by Heikes and Randall (1995b). Several numerical optimization algorithms have been proposed to improve the mesh, including the spring dynamics model (Tomita et al. 2001) and the centroidal generation algorithm (Du et al. 1999). Numerical optimization methods usually improve a certain mesh property at the expense of another. For example, an algorithm could trade face area uniformity for vertex angle disparity. Another problem with numerically modified meshes is that the optimization process is specific to each division and the resulting meshes lose their nestable property, i.e., become unsuitable for mesh refinement (Putman and Lin 2007). Because we anticipate such development in the future, and because we have not observed any adverse effects from using the simple recursive mesh, it is our preferred method of construction.
The triangular tesselation is extruded radially over a number of concentric spherical layers called shells, to produce the threedimensional TGM. The software stores the reciprocal connectivity tables for every element on the sphere (vertex, edge, or face) at all divisions, up to the maximum allowed. In addition, there are tree structures describing the parentchild relationships between the faces. For the purpose of domain decomposition, a face subdivided into higher division faces is called a sector and a layer of consecutive shells is called a slab. An intersection between a sector and a slab is called a block, which is the computational unit on this mesh. Each computational zone has the shape of a truncated triangular pyramid also known as a frustum.
Locating an arbitrary vector (i.e., finding the zone containing the vector) on the TGM follows a simple procedure valid for any nested polyhedral tesselation. Once the shell number has been determined (via a mapping function or bisection search), the vector is normalized to unity. The nearest division 0 vertex is found by computing the largest scalar product with all 12 vertices at that division. Next, the algorithm tests which of the five surrounding tfaces the vector belongs to, and then recursively tests the four daughter faces at each division. A test for the tface interior consists of computing the triple products of the vector with two consecutive vertices (1–2, 2–3, and 3–1). If all three triple products are positive, the point belongs to the interior of the tface with counterclockwise vertex ordering.
Partitioning the mesh into sectors and slabs enables efficient domain decomposition and offers many opportunities for parallelization. The software framework uses MPI and MPIderived libraries and achieves essentially linear weak scaling (Balsara et al. 2019). We will next concentrate on a single triangular block and describe its partitioning into computational zones, generating stencils, and performing reconstruction of zone based mesh variables with a desired order of accuracy.
Grid blocks
The tree numbering system for the faces, edges, and vertices is too slow to be used for zone access within a sector, for which we introduce a flat, twodimensional “triangular addressing scheme”, or TAS. The face numbering pattern is illustrated in Fig. 3 which shows one block of a mesh whose sector division \(d_{s}\) is three less than its face division (\(\Delta d=dd_{s}=3\)). In this example the sector has two layers of ghost zones around its interior. The numbering starts from the base vertex identified by the tesselation; the sector is always drawn in an orientation where the principal vertex is in the SW corner. The first coordinate index runs from W to E and the second index runs from SE to NW. The alternating color shading in Fig. 3 is used to distinguish faces with opposite orientations; many of the vector operations are performed with the opposite signs for the shaded (yellow) and unshaded (white) faces.
The number of vertices, tedges, and tfaces in a sector with \(N_{g}\) layers of ghost zones are
where
is the length of the side of the sector. Note that the number of tedges is three times the number of unshaded faces; it is often convenient to access the edges using a loop on unshaded faces only. The numbering scheme used for the tedges and vertices is similar to that used for the faces. The edges are numbered in a specific order: first all NE edges, then all NW edges, and finally all S edges (relative to the respective unshaded tface).
Figure 3 draws with different colors the boundaries of the blocks of ghost zones used to exchange information with the neighboring sectors. The boundary exchange process is discussed in some detail in Sect. 8. Here we only mention that the grey bordered triangular regions may be absent if the block contains one or more pentacorners, which are the vertices of the original icosahedron. These vertices have only five neighbor elements rather than six, and care must be taken to adjust stencil generation procedure and boundary exchanges between blocks near these special points. For example, if the principal vertex of the block shown in Fig. 3 is a pentacorner, tfaces 6, 7, 8, and 13 are absent, and the mesh must be closed along the cut line that appears in place of the missing faces.
Grid blocks also maintain a set of local connectivity tables similar to those listed in Table 2. These tables have a very regular pattern and are much simpler to construct than the tesselation tables; all neighbors are ordered in counterclockwise direction. The tedge orientation is defined with respect to its unshaded neighbor face, which fixes the directions of the normal and tangent vectors on the mesh.
Each grid block needs to know the coordinates of every vertex in the local grid. Because the tesselation numbers its tfaces and vertices differently from the grid blocks, a routine is provided to assemble a list of vertices that lie in a requested sector with ghost cells in the TAS format. The convention is that the base vertex is the first vertex in the FV set of the sector. The mapping routine walks the sector, including the ghost tfaces, from W to E and from SE to NW, storing the coordinates of the vertices encountered along the path. Three step operators are defined, all relative to the base vertex of the tface, shown in Fig. 4. A type 1 step moves from the initial tface (\(t_{i}\)) to the final face (\(t_{f}\)) in the S direction and the new base vertex (\(v_{f}\)) is to the E of the old base vertex (\(v_{i}\)) on the common edge. A type 2 step moves diagonally to the NE, and the new base vertex is opposite to the initial base vertex. Finally, a type 3 step moves to the NW, but the new base vertex belongs to the common edge. In Fig. 4, the vertex moves are shown with orange arrows and the face moves with red arrows. These three operations apply to unshaded to shaded tface movement. The shaded to unshaded step operators are algorithmically identical to those, and correspond to switching the initial and the final tfaces and vertices, and reversing the arrow directions.
The sector walk routine works as follows. From the base vertex of the sector, the code first walks to the NW until it encounters the left side of the block (tface 25 in Fig. 3). Then the code walks to the SW until it reaches the corner of the grid block (face number 1 in the grid block’s numbering scheme). From there, the code makes a step to the right followed by i steps diagonally (SENW), where i is the index of the horizontal step. That way every cell in the block is visited once. Note that the alternating pattern of shaded and unshaded tfaces is broken across the cut line, and special versions of the step operators are needed to move between the faces of the same shading.
Representing spherical geometry
In principle, it is possible to perform all calculations on a TGM by directly using spherical geometry. We found, however, that using isoparametric mapping from a reference zone, which in this case is a right triangular (equilateral) prism, offers significant advantages. In particular, integration on spherical triangles is difficult, requiring a large number of quadrature points at higher orders (Beckmann et al. 2012). Integration on the reference element is straightforward by comparison.
The physical zone and its reference image are shown in Fig. 5. The left panel shows the physical zone that has the shape of a truncated triangular pyramid, also called a frustum. The spherical top and bottom caps are the tfaces, and the annular sides are the rfaces. The frustum therefore has three rfaces and two tfaces. The edges of the tfaces are called tedges, and the edges connecting the bottom and top tfaces are called redges. There are six tedges, three redges, and six vertices per zone. The vertices belonging to a tface are numbered counterclockwise in its connectivity tables, 1 through 3, and the tedges of each tface are also numbered counterclockwise, 1 through 3. By convention, a vertex has the same index as the opposite tedge.
A point in reference space is addressed with a coordinate triplet (ξ, η, ζ). The bottom and the top faces of the prism lie in the planes \(\zeta =0\) and \(\zeta =1\), respectively. The area of the tface in reference coordinates is \(\sqrt{3}/4\), the area of the rface is one, and the volume of the prism is \(\sqrt{3}/4\). It is convenient to work with barycentric coordinates in the ξη plane (\(\varLambda _{1}\), \(\varLambda _{2}\), \(\varLambda _{3}\)), defined in Chap. 8 of Zienkiewicz et al. (2013) as
where \(\xi _{i}\) and \(\eta _{i}\), \(i=1,2,3\), are the ξ and η components of the vertices of the triangle in the reference space. The barycentric coordinates are equal to the partial areas of the subtriangles formed by the point \((\xi , \eta )\) and the three vertices of the reference triangle (please note that this is not true for the areas of the respective curved triangles). For the equilateral reference triangle the inverse of (4) is
We next introduce a set of twodimensional linearly independent Lagrange basis functions associated with the nodal points on the curved triangular faces that fix the mapping from reference space to the physical space. It is convenient to compute the nodal point coordinates on the unit sphere; the physical coordinates are obtained simply by rescaling to the desired radial distance. We denote vectors that lie on the unit sphere with the superscript “u”. All coordinates are factored as
where
where \(r_{b}\) and \(r_{t}\) are the radial distances of the nodal points on the bottom and the top tface, respectively, and ρ is their ratio. As discussed below, this factoring enables a more efficient implementation of the reconstruction algorithm on the TGM compared with fully unstructured tetrahedral meshes. To perform integration we also require a set of curvilinear unnormalized basis vectors
Given N nodal points on a triangle, there are N Lagrange basis functions \(\psi _{i}(\xi ,\eta )\) that satisfy
where \((\xi _{j},\eta _{j})\) are the coordinates of nodal point j on the unit sphere. A position vector \(\mathbf{x}^{u}\) can be represented as an expansion over the basis functions
The coefficients in this expansion are the physical coordinates of the nodal points \(\mathbf{v}^{u}_{i}\). Figure 6 shows the locations of the nodes on the reference triangle. These elements use \(N=3\), 6, and 10 for linear, quadratic, and cubic basis functions, respectively. The explicit formulas for the basis functions on the equilateral triangle are given in Appendix A. Note that the maps from two adjacent tfaces are continuous at the shared tedge by virtue of the use of barycentric coordinates for their construction.
An expansion similar to (10) is used for the tedges. Points from the surface element lying on that edge are used (see Fig. 6) and the corresponding basis functions are simply restriction of the facial bases functions for one of the barycentric coordinate equal to zero. It is convenient to introduce an auxilliary variable δ that measures distance along the edge in the counterclocksise direction. Its relation to barycentric coordinates is shown in Table 3. The basis functions \(\phi _{i}(\delta )\) for the edges can be also found in Appendix A.
It is instructive to evaluate the disparity between the mapped surface given by Eq. (10) and the ideal surface, i.e., the unit sphere. Below we compute the error in the radial coordinate, \(1r^{u}\) for a mapped equilateral spherical triangle with a circumcircle radius of 5^{∘}. Figure 7 shows the error distribution for element orders one, two, and three. Obviously, the first order element with its planar faces is unable to reproduce the spherical shape resulting in a large error near the center. Switching to the second order element improves the accuracy by three orders of magnitude, while going to third order yields another factor of ∼20. It is evident that both second or third order elements reproduce spherical geometry with remarkable accuracy.
It is worth mentioning that Ivan et al. (2013) have previously developed an isoparametric cube sphere model based on a cubic reference element. However, their trilinear mapping anchored at the four corners of the quadrilateral tface is not capable of truly reproducing a spherical surface because it has only one extra degree of freedom compared with the linear map. For example, when all four vertices lie in the same plane, the trilinear map yields a surface that is flat instead of curved.
Evaluation of integrals on a geodesic mesh
A finite volume scheme requires evaluating multidimensional integrals in the initial setup phase and during time updates of the conserved variables. This requires, at a minimum, volume and surface integrals. The use of constrained transport scheme to advance the magnetic field requires, in addition, evaluation of integrals along the edges (see Sect. 7 below). We will therefore define the following integral operations: volume integration over a zone, surface integration on tfaces and rfaces, and line integration on tedges and redges. For a threedimensional vector variable V these are defined as
where the symbol ‘Δ’ designates integration over a triangle. We will now describe our strategy for evaluating the integrals using quadrature rules. Consider a single zone in the mesh addressed with a tface index f whose top and bottom vertices lie at r and ρr, respectively. Further, suppose e is the index of one of the tedges of the zone, and v is one of the vertices.
Integration on redges
Redges are addressed by the vertex index with specified r and ρ. Because rfaces are always straight, the integrals can be evaluated directly using Gauss–Legendre quadrature points. Define such set of points on the reference interval \(\zeta =[0,1]\) as \(Q_{1r}\). Each quadrature point q has position \(\zeta _{q}\) and weight \(w_{q}\). Then it is evident that
where \(\mathbf{x}^{u}_{v}\) is the position of the vertex v on the unit sphere and
is the elevated radial position. The code uses 1 quadrature point for integrating polynomials of degrees zero and one, 2 points for degrees two and three, 3 points for fourth and fifth degree polynomials, etc.
Integration on tedges
Tedges are addressed by the edge index with fixed r. These edges are curved (except when using linear basis functions) and the quadrature weights are therefore multiplied by the Jacobian equal to the length of the tangent vector \(\mathbf{h}_{\delta }\). Again, designate the set of Gauss–Legendre points on the reference interval \(\delta =[0,1]\) as \(Q_{1t}\) (which may or may not be the same as \(Q_{1r}\)). Using the definition (8) we can write
where \(\delta _{q}\) are the locations of the quadrature points on the reference interval and
Here the subscript ‘e’ refers to the fact that the map specific for edge e is used to evaluate the coordinate and its derivative. We use the same number of points for tedge integration as for redge integration. In practice, the values of the point coordinates and tangent vectors on the unit sphere are precomputed for each tedge at the start of a simulation for fast retrieval.
Integration on rfaces
Rfaces are addressed by the edge index with specified r and ρ and approximate annular regions (trapezoids for elements of order 1). The position is specified via the \((\delta ,\zeta )\) pair of coordinates. We now introduce quadrature points on the reference square \((\delta ,\zeta )=[0,1]\times [0,1]\) as \(Q_{2r}\). These points are conveniently computed as tensor products of the Gauss–Legendre quadrature points. The quadrature rule for rfaces can be written as
with \(\mathbf{x}^{u}_{q}\) given by Eq. (19).
The right panel of Fig. 8 shows the locations of the points on the reference square. On a rectangle, three points are sufficient for exactly integrating a quadratic polynomial, four for cubic, and six for quartic. However, it is our intention to maintain exact polynomial integration rules for first order elements, where the rface is a trapezoid. Its Jacobian is linear in the ζ coordinate, and the order of accuracy is reduced by one. For this reason we use four, six, and nine point rules to integrate polynomials of degrees two, three, and four, respectively.
Integration on tfaces
Tfaces are addressed by the face index with fixed r. They approximate spherical triangles (flat triangles for linear coordinate transformation). The position is specified via the \((\xi ,\eta )\) pair of coordinates, and the set of quadrature points defined on a unit equilateral triangle is designated as \(Q_{2t}\). Here we use the symmetric quadrature rules given in Dunavant (1985) with quadrature point locations shown in the left panel of Fig. 8. The integration algorithm for tfaces is
where
Three, four, and six points are sufficient to integrate a quadratic, cubic, and quartic polynomial exactly on a flat triangle. The fourpoint rule should be avoided because it has a negative weight, and we use the six point rule at third order. These points and the normal vectors are also precomputed for each tface.
Integration on frustums
A frustum can be addressed by the face index with specified r and ρ. Defining a position requires all three reference coordinates \((\xi ,\eta ,\zeta )\). We arrange the quadrature points in p “planes”, where each plane corresponds to a triangular quadrature rule with a set of points \(Q_{2t}\) described in the previous subsection. The planes themselves are located at \(\zeta _{p}\) corresponding to the Gauss–Legendre points on \([0,1]\) that we designate as \(P_{1}\) with the plane weights given by \(w_{p}\). Then a volume integral can be evaluated as
where \(\mathbf{x}^{u}_{q}\) is given by Eq. (22). We use two quadrature planes for polynomials of degrees 0 and 1, three for polynomials of degrees 2 and 3 and four for degrees 4 and 5.
In curved spaces the total degree of the reconstruction polynomial increases significantly upon transformation to the reference coordinates. For example, a third degree polynomial in x on a quadratic surface element gives an integrand or degree \(3^{2}+2=8\) in α and β, where the Jacobian adds two extra powers. The same polynomial on a cubic element gives an integrand of degree \(3^{3}+4=13\). However, it is quite unnecessary to match the order of the quadrature algorithm to the resulting total degree of the polynomial in the reference space because the truncation error decreases at the rate imposed by the quadrature scheme alone. The magnitude of error depends on the details of the coordinate mapping, but the order of convergence does not.
Conservative reconstruction on a geodesic mesh
The TGM framework presented here is intended to be used primarily with finite volume schemes for systems of PDEs. These methods usually operate on conserved (extrinsic) physical variables associated with each zone in the mesh. Conserved variables are advanced in time using the fluxes evaluated at the zone boundaries. The fluxes may be generated by means of a Riemann solver that computes, often approximately, the selfsimilar wave pattern developed from an interaction of two or more constant states. The Riemann solver may be invoked for a set of points in each face, and the total flux is evaluated as the average over these points. The invocation of multiple Riemann solvers at suitably placed quadrature points within each face of the mesh contributes to the high order accuracy of the scheme.
The constant states fed to the Riemann solver are obtained via highorder spatial reconstruction of the conserved variables, which amounts to finding a functional form of the variable within each zone consistent with a given piecewise distribution at the beginning of the time step. Reconstruction is performed on a set of stencils associated with each zone (the principal zone of that stencil) that include zones in a certain proximity to the principal. We use conservative polynomial reconstruction (known in onedimensional or directionally split applications as reconstruction via primitive functions) from multiple stencils for each computational zone.
Stencil construction
We now discuss the reconstruction strategy focusing on the TGM specific issues. At the start of a simulation a set of stencils is built for each computational zone. The number of zones in a stencil cannot be smaller than the number of degrees of freedom in the polynomial reconstruction, given by
where M is the degree of the reconstruction polynomial. It has been argued that using the number of zones in the stencil equal to \(D(M)\) does not always produce satisfactory results (OllivierGooch and Van Altena 2002). For this reason we use overdetermined stencils that are larger than the minimal size. With such stencils the conservative property of the reconstruction is enforced in the least squares sense.
The zones in the TGM are arranged in a regular pattern (see Fig. 3) allowing us to design universal stencils valid on any mesh. The zones in a stencil are arranged in “planes” that correspond to different radial shells. Each plane consists of a twodimensional tface stencil. The principal plane contains the largest 2D stencil and the other planes contain progressively smaller stencils. Figure 9 shows the choice of 2D stencils available in the code. In addition to the symmetric central stencil that is used in regions where the solution is smooth (top row of Fig. 9), twelve directional stencils are defined to be used in situations where the central stencil produces a large variation due to a sharp gradient or discontinuity in the solution (Käser and Iske 2005). Directional stencils can point in the in or outward radial direction and along six directions in a plane (three forwardbiased and three backwardbiased, see Käser and Iske (2005) for the explanation of these terms). We use three, five, and seven planes per central stencil and two, three, and four planes per directional stencil for \(M=1\), 2, and 3, respectively. The code can use all thirteen stencils, but can also be run without backward stencils which nearly halves the execution time of the reconstruction step.
Contrary to the fully unstructured meshes, stencils on the TGM can be generated using predefined patterns and in principle need not rely on mesh connectivity information. The exception to this rule are the pentacorners, where some of the neighbors may be missing. Figure 10 shows some examples of stencils in the principal plane that could be used for third order polynomial reconstruction. The central stencil, shown in the top panel, clearly contains a pentacorner. The middle row shows the forward and the bottom row the backward stencils. Notice how the first of the backward stencils has a different shape than the other two. If a stencil is found to be defective (i.e., contains fewer zones than required), the software will repeatedly upgrade to the next largest stencil until the order condition is fulfilled.
Consider a conservative mesh variable U defined via its averages over each zone i, \(\bar{\mathbf{U}}_{i}\). A reconstruction of this variable in zone i using Mth degree polynomials can be written as
where multiindex notation is used with \(\alpha =(\alpha _{1},\alpha _{2},\alpha _{3})\), \(\vert \alpha \vert =\alpha _{1}+\alpha _{2}+\alpha _{3}\), and \(x^{\alpha }=x_{1}^{\alpha _{1}}x_{2}^{\alpha _{2}}x_{3}^{\alpha _{3}}\). The term \(\langle x^{\alpha }\rangle _{i}\) denotes the moment of zone i, divided by the volume of the zone, and \(\mathbf{U}_{i}^{\alpha }\) is the coefficient (or mode) in the reconstruction. To enforce the conservation property \(\langle \mathbf{U}(\mathbf{x})\rangle _{i}=\mathbf{U}^{(0,0,0)}_{i}= \bar{\mathbf{U}}_{i}\) one must formally set \(\langle x^{(0,0,0)}\rangle _{i}=0\) in (25). The remaining moments are computed using high order quadratures given by Eq. (23). The moments are computed in Cartesian coordinates. These moments are transformed into the center of mass frame of the zone using the parallel axis theorem (for details, see Balsara et al. 2019) and scaled by the characteristic length determined by the dimensions of the zone.
An optimal choice of stencils should achieve a balance between accuracy and performance. To find this balance we have performed a statistical study of error in the reconstruction with cubic polynomials (i.e., at fourth order of accuracy) using only the central stencil, as a function of the number of zones in the stencil. The results, presented in Appendix B, demonstrated that where as the \(L_{\infty }\) error can become unacceptably large for the minimal stencil, the deficiency is cured by increasing the stencil size by as little as 15%. Past this point, both the \(L_{1}\) and the maximum errors have a weak increasing trend previously noted in Ivan et al. (2015). Based on these results, we introduced an adjustable parameter in the code to set the minimum number of zones in the stencil to be slightly larger than \(D(M)\).
Utilizing radial similarity
A spherical mesh commonly has shell thickness varying with radial distance to satisfy the needs of the particular computational problem. Let us introduce a dimensionless variable \(\chi \in [0,1]\) and a mapping \(r(\chi )\) that satisfies \(r(0)=r_{\mathrm{min}}\), \(r(1)=r_{\mathrm{max}}\), where \(r_{\mathrm{min}}\) and \(r_{\mathrm{max}}\) are the inner and the outer boundaries of the entire simulation domain, not including the ghost shells. One example of such a mapping is a power law
where b is some positive real number. The interior of the simulation domain is partitioned into L shells of equal width \(\Delta \chi =L^{1}\) that map physical shells of variable widths \(\Delta r(r)\). Suppose the zone i is indexed by shell s and face f. In physical coordinates the zones corresponding to the same f but different s have different aspect ratios. For example, for the mapping (26) the zones closer to the origin will be more radially elongated than those at larger distances (for \(b>1\)).
One particular function of χ preserves the zone aspect ratio, such that \(\Delta r/r=\mathrm{const}\). This is the exponential mapping,
(e.g., Koldoba et al. 2002), that also satisfies \(r'(0)=r_{\mathrm{min}}\), \(r'(1)=r_{\mathrm{max}}\). One can then introduce exponential coordinates given by
where, as before, the coordinates with the superscript ‘u’ are measured on the unit sphere.
A conserved mesh variable \(\mathbf{U}(\mathbf{x})\) is defined via
Integration over the solid angle Ω corresponds to integration on the unit sphere. Equation (29) can be rewritten in exponential coordinates as
where \(\varOmega _{f}\) is the area of face f on the unit sphere. We next introduce a threedimensional polynomial reconstruction of the quantity \(\mathbf{W}=\mathbf{U}r^{2}/r^{\prime 3}(dr/d\chi )\) in the zone i
where \(\tilde{\mathbf{x}}_{s}=\mathbf{x}'/r'_{s}\) is the position vector expressed in the exponential normalized coordinates (ENC). Here they are normalized to the exponential distance to the bottom of the zone. The moments of any zone with a face index f are
where
which is the same for all shells s. In the ENC the moments are independent of the shell, so the index s is dropped for them. It is evident that
To obtain the remaining modes a geometry matrix is computed for each threedimensional stencil. Suppose \(S_{i}\) denotes the set of zones comprising the stencil, and that the zone j that belongs to this stencil, \(j\in S_{i}\), \(j\neq i\) is indexed by shell σ and face ϕ. Using the fact that
averaging (31) over a given zone in the stencil, which uses the ENC specific for its own shell σ, rather than the principal shell s, yields
This is a linear system for \(\mathbf{W}_{i}^{\alpha }\). The geometry matrix on the LHS has the number of rows equal to the number of zones in the stencil, without counting the principal zone, and its column count is \(D(M)1\). The geometry matrix’s coefficients only depend on the relative shell displacement in the stencil, \(\sigma s\), and are identical for any zone with the same face index because the corresponding stencils all have the same structure.
The advantage of the described scheme is that the amount of storage is significantly reduced (by the factor equal to the number of shells in the block) compared with the method that treats each zone as unique. Only a single copy of each moment and the geometry matrix are needed per tface. This also permits us to precompute the LU decomposition or inverse of each geometry matrix and store it to perform reconstruction with a different RHS in (36) at each time step. The physical variable is then recovered via
Limiting the reconstruction
The code performs reconstruction on all thirteen (or seven) stencils and stores the resulting modes for each stencil. The solutions from multiple stencils are combined in a nonlinear fashion into a single reconstruction polynomial using the weighted essentially nonoscillatory (WENO) method (Harten and Osher 1987; Shu and Osher 1988; Liu et al. 1994; Jiang and Shu 1995; Friedrich 1998; Balsara and Shu 2000; Dumbser and Käser 2007). The nonlinear hybridization helps to stabilize the WENO scheme when local discontinuities develop in the flow.
Suppose there are S stencils associated with face i, with the central stencil bearing the index 1, and the directional stencils numbered 2 through \(S=7,13\). The central stencil is the most accurate and therefore carries the largest linear weight, \(\gamma _{1}=\in [0.85,0.95]\), where as the remaining stencils have \(\gamma _{s}=(1\gamma _{1})/(S1)\). Suppose we need to perform a reconstruction of a scalar variable \(U(\mathbf{x})\). The WENO procedure computes a weighted average of the reconstruction polynomials derived on each of the stencils with preference given to stencils achieving a smoother reconstruction (roughly speaking, having smaller absolute values of the modes \(U^{\alpha }_{is}\) where \(\vert \alpha \vert >0\) and \(s=1,\ldots,S\)). The scheme is biased by the smoothness indicators that can be estimated simply as
We have implemented plain second and third order WENO schemes and an adaptive order WENOAO(4,3) scheme within the TGM framework. The plain WENO procedure computes the nonlinear weights as
where \(\epsilon \sim 10^{12}\) is used to avoid possible division by zero. The weights are then normalized so that they add up to unity. The normalized weights are obtained as
The coefficients of the hybrid reconstruction polynomial are computed as
At fourth order of accuracy we have used an adaptive order method to avoid the excessive computational cost of performing high order reconstruction on all thirteen stencils. The WENOAO method has been described in great detail in Balsara et al. (2016), while its implementation on unstructured meshes was presented in Balsara et al. (2019, 2020). Here we only discuss some specifics of its implementation on the geodesic mesh. The WENOAO(4,3) method uses, in addition to the set of stencils used to perform thirdorder reconstruction, a large central stencil that we assign the index of 0 to avoid relabeling of the thirdorder stencils. This large stencil is used to perform reconstruction of polynomial degree 3 and carries the linear weight \(\gamma _{0}=\in [0.85,0.95]\). For example, the third order central stencil may be the stencil shown in the fourth or fifth column of Fig. 9, while the fourthorder stencil will be from column seven or eight of that figure. The linear weights \(\gamma '_{s}\) of the adaptive order scheme are given by
(note that the number of stencils used in this case is \(S+1\)). The smoothness indicators and nonlinear weights are obtained according to (38) and (39), respectively using \(\gamma '_{s}\) in place of \(\gamma _{s}\), where \(s=0,\ldots,S\). The normalized nonlinear weights are given by
The coefficients of the hybrid reconstruction polynomial in the adaptive case are computed as
Expression (44) reduces to \(U^{\alpha }_{i0}\) in the limit that the solution is smooth on all stencils and therefore \(\bar{w}_{is}\to \gamma '_{s}\). This choice yields the most accurate reconstruction because it is based entirely on the large central stencil.
The reconstruction procedure is carried out in each zone lying in the interior of the block and in two more layers of ghost zones. The latter is needed by the slope flattening procedure that scales down the reconstruction coefficients within the zones lying near strong density enhancements. The stencils shown in Fig. 9 extend a distance equal to the degree of the reconstruction polynomial beyond the principal zone. As a result we use three layers of ghost zones at second order of accuracy, four at third order and five at fourth order.
Constrained reconstruction of the magnetic field
For MHD problems, it is essential to keep the magnetic field divergence free. The most successful technique to maintain \(\nabla \cdot \mathbf{B}=0\) is the constrained transport method (Evans and Hawley 1988; DeVore 1991; Ryu et al. 1998; Balsara and Spicer 1999) that is based on the Yee type staggered mesh. In this approach the magnetic field is a face based variable, unlike the zone averaged mass, momentum, and total energy conserved variables. More specifically, the variable is a normally projected, face averaged value of the magnetic field that will be called B̄, possibly with a subscript of the face where it is defined. This magnetic field is initialized using the vector potential
and is updated in time via Faraday’s law,
where E is the electric field and SI units are used. Integrating equations (45) and (46) requires edge based vector potential and electric field, respectively, in applying the Stokes theorem.
Let us focus on a single zone with index i in the mesh. Denote by \(F_{i}\) the set of faces that belong to this zone. The set can be further partitioned into three rfaces (set \(R_{i}\)) and two tfaces (set \(T_{i}\)). By convention, the normals \(\hat{\mathbf{n}}_{j}\) for \(j\in R_{i}\) are directed outward as viewed from a zone corresponding to an unshaded tface (and hence inward as viewed from a shaded face, see Fig. 3), where as the normals for \(j\in T_{i}\) always point in the outward direction (direction of increasing r). Further, suppose \(E_{j}\) is the set of edges that comprise the boundary of face j. For \(j\in R_{i}\), the boundary consists of two tedges and two redges; while faces \(j\in T_{i}\) have three tedges. The tangent vectors to the tedges are assumed to be directed counterclockwise relative to the unshaded face while the redge tangents point outward.
Using the above conventions, the facebased magnetic field initialization procedure is written as
where \(S_{j}\) is the area of face j, \(l_{k}\) is the length of the edge k, and \(\bar{A}_{k}\) is the average over the edge k of the vector potential dotted with the tangent vector to that edge. The line integral in (47) is evaluated using formulae (16) and (18). In addition, the integral divergence free condition for \(\mathcal{D}=\nabla \cdot \mathbf{B}\) may be written as
where \(V_{i}\) is the volume of zone i. In practice, the numerical code defines variables of zone, face, and edge types and the curl and divergence integral operations to perform “conversions” between the types.
Following Balsara and Dumbser (2015a) the model presented here uses a supplementary zone based vector variable \(\mathbf{B}'\). At the start of the simulation, this variable must be initialized in each zone i in some way consistent with the primary field B̄ defined on \(F_{i}\). One possibility is to use the least squares fit
The integral in the above equation is evaluated using (20) and (21), giving five equations (one per face) for the three unknown field components. The alternative is to initialize \(\mathbf{B}'\) directly as a zone variable using the expression for the field rather than the potential. The resulting \(\mathbf{B}'\) is subsequently treated like any other zone variable. In particular, it is subjected to the same volume reconstruction procedure described in the previous section. This reconstruction is not functionally divergence free, and an additional procedure, described below, is applied to obtain a constrained reconstruction. This approach represents a low computational cost alternative to a face based reconstruction.
Suppose the preliminary, nondivergencefree reconstruction, computed as discussed in the previous section, is given by
where \(\mathbf{B}_{i}^{\prime \alpha }\) are the modes. We seek a constrained polynomial reconstruction for the magnetic field \(\tilde{\mathbf{B}}(\mathbf{r})\) as
These reconstructions have \(\tilde{D}(M)=2D(M)D(M1)\) degree of freedoms, which is larger than \(D(M)\). While the degree of the reconstruction polynomials (51) is one higher than of (50), not every additional high order mode is present. The need for the extra modes will be demonstrated shortly. We now describe the five separate constraints imposed on the magnetic field modes that ensure that the magnetic field remains divergencefree not only in the integral sense (zero total flux through all faces of a zone), but also functionally at any location within the zone.
Constraint 1
This step ensures that the polynomial reconstruction of the magnetic field has zero divergence everywhere in the zone. Taking the divergence of Eq. (51) and making the resulting polynomial expression equal to zero yields \(D(M)\) equations of the form
Clearly, \(\tilde{B}_{1}\), \(\tilde{B}_{2}\), and \(\tilde{B}_{3}\) modes with \(\alpha _{1}=0\), \(\alpha _{2}=0\), and \(\alpha _{3}=0\), respectively, do not contribute to (52). Only the extra modes that contain powers of \(x_{1}\) for \(\tilde{B}_{1}\), \(x_{2}\) for \(\tilde{B}_{2}\), and \(x_{3}\) for \(\tilde{B}_{3}\) are included. For instance, at third order of accuracy (\(M=2\)) the extra modes present in the first equation of (51) are those containing \(x_{1}^{3}\), \(x_{1}^{2} x_{2}\), \(x_{1}^{2} x_{3}\), \(x_{1} x_{2}^{2}\), \(x_{1} x_{2} x_{3}\), and \(x_{1} x_{3}^{2}\), where as the second equation includes \(x_{1}^{2} x_{2}\), \(x_{1} x_{2}^{2}\), \(x_{1} x_{2} x_{3}\), \(x_{2}^{3}\), \(x_{2}^{2} x_{3}\), and \(x_{2} x_{3}^{2}\) terms. The remaining high order modes do not contribute to the local divergencefree conditions.
Constraint 2
The second constraint imposed on the reconstruction (51) is the requirement that its normal component, evaluated from any two adjacent zones sharing the face j and averaged over that face must be equal to \(\bar{B}_{j}\), namely
where the integral is evaluated according to the rules (20)–(21). This is the requirement of zero divergence in the integral sense. The order of the quadrature rule need not be very high, but only sufficient to match the order of the overall scheme. For example, for a third order scheme that uses polynomials of up to third degree, we use six point quadratures on all faces.
It should be pointed out that because of (53) one constraint in (52) is redundant. This is readily demonstrated by computing the divergence of \(\tilde{\mathbf{B}}\) (Eq. (51)) analytically, integrating over the volume of the zone, and setting the integral to zero. For the sake of symmetry, we chose to discard the first equation in (52), so that system’s equation count is reduced to \(D(M)1\).
Constraint 3
Balsara and Dumbser (2015a) proposed a method seeking to match, at each face, complete polynomial reconstructions of the normal component of the magnetic field. Here we use a weaker requirement that the reconstructions of the normal component should approximately match at the facial quadrature points used to perform integration on that face. This procedure nonetheless ensures a very close matching of the modes of the magnetic field within each face.
The matching procedure starts by evaluating \(\mathbf{B}'_{i}(\mathbf{x})\) from (51) at each quadrature point of face \(j\in F_{i}\) and projecting it onto the unit normal to the face at that point. Initially this normal component is not continuous at the zone boundaries, so there are two values of the normal component, \(B_{iq}\) and \(B_{kq}\), at each facial quadrature point q contributed by two adjacent zones i and k, where \(j\in F_{i},F_{k}\). The common normal component at each quadrature point q, \(B_{q}\), is evaluated in two steps as
where \(B^{*}\) is the intermediate value of the common normal component of the field at the interface and the angular brackets denote its average over the face j. The normal component of the magnetic field given by (55) is continuous and its average over the face matches the respective value of the primary variable \(\bar{B}_{j}\). Therefore, the third set of constraints can be written as
for each quadrature point q, with \(j\in F_{i}\). The number of conditions in (56) is equal to the total number of quadrature points on all five faces of the frustum.
Constraint 4
Next, we demand that the divergencefree reconstruction (51) should be as close to the volume reconstruction of \(\mathbf{B}'\) as possible, i.e.,
Equation (52) is based on the observation that the initial (unconstrained) volume reconstruction is the best possible starting point for determining the constrained modes. With this condition the convergence order of the constrained reconstruction stays close to the order of convergence of the unconstrained volume reconstruction.
Constraint 5
In the same spirit it is desirable that the “extra” high order modes should be small, i.e.,
Table 4 provides the counts of the degrees of freedom and the number of equations contributed by formulae (52), (53), (56), (57), and (58) for schemes of second, third, and fourth orders of spatial convergence. Since there are more equations than unknowns, only the local and global divergencefree conditions (52) and (53) are strictly enforced; the remaining conditions can only be satisfied approximately, in the least squares sense (in principle, at third and fourth order of accuracy the constraints (56) can also be strictly imposed). This constitutes a constrained linear least square (CLSQ) problem. Figure 11 illustrates the structure of the LLS and constraints matrices at fourth order. From Table 3, the rank of the Karush–Kuhn–Tucker (KKT) matrix of the CLSQ problem is 29, 62, and 114 at second, third, and fourth order of accuracy. Note that despite the sparsity of the LLS and the constraint matrices, the KKT matrix is largely dense.
Based on the results of the previous section, it may be expected that only a single KKT matrix needs to be constructed and inverted per tface. Unfortunately, the difficulty here is with the global divergencefree condition (Constraint 1), which is, in general, incompatible with the reconstruction (31). Coordinate factorization is still possible, but only if the mesh is directly exponentially rationed, i.e., \(r=r'\) and \(\mathbf{W}=\ln (r_{\mathrm{max}}/r_{\mathrm{min}})\mathbf{U}\). This is the mesh that was used for all MHD applications discussed below.
At the end of the magnetic field reconstruction step, the previously obtained unconstrained modes are discarded and replaced with the constrained version. This ensures synchronization between the primary and supplementary magnetic field variables used by the code.
Time advance and boundary exchange
The complete finite volume method is implemented as follows. First, the zonebased variables (including \(\mathbf{B}'\)) are reconstructed to the quadrature points on the faces as described in the previous two sections. Pairs of states from each side of the interface are fed into a Riemann solver. We employ the HLL family of nonlinear solvers (Harten et al. 1983; Einfeldt 1988) that are very robust and usually positivity preserving as long as the speeds of the extremal waves are properly estimated. The popular HLLC solver (Batten et al. 1997; Gurski 2004; Li 2005) consists of four states separated by two fast shocks and a tangential discontinuity. The HLLD solver (Miyoshi and Kusano 2005) adds a pair of rotational discontinuities, and is therefore less dissipative than HLLC, but is somewhat less robust and can fail for certain combinations of input states. Our approach is to start with the least diffusive solver, downgrading to the more dissipative solver when the former fails to deliver a positive resolved state. The fluxes are evaluated at each quadrature point and combined together to obtain the total flux through a face. These fluxes update the conserved variables in the zone using a TVD Runge–Kutta scheme (Shu and Osher 1988). A version of the code is also available that uses the socalled arbitrary derivative (ADER) update technique (Dumbser et al. 2008; Balsara et al. 2009). The ADER implementation on the geodesic mesh has been reported elsewhere (Balsara et al. 2019).
Unlike the zone variables, the magnetic fields are reconstructed to the quadrature points lying on the edges. A single point is sufficient at second order and two points at third and fourth orders. The constrained magnetic field is used here in place of the nonconstrained reconstruction. Each tedge receives four states and each rface five or six states depending on whether it is a pentacorner or not. These states are fed into a multistate twodimensional Riemann solver (Balsara 2010, 2012, 2014; Balsara and Dumbser 2015b) generating the electric field at the edges (the remaining flux components are discarded). The 2D Riemann solver used here is of the HLLI type (Dumbser and Balsara 2016) that can include every MHD wave, including the Alfvén and slow magnetosonic waves. The facebased magnetic field is updated via the same Runge–Kutta procedure. This operation conserves the divergence of B to the machine precision.
A correct implementation of the above scheme must ensure that all variables are properly synchronized at the block boundaries. Each block can have up to 38 neighbors which at some point in the calculation must send some of their zone, face, or edge based boundary data and received equivalent data in return to fill in the ghost mesh element or synchronize the common boundaries. The implementation described here does not use neighbor lists, instead delegating all bookkeeping tasks to the message passing library.
Figure 12 demonstrates the typical mesh topology. Ten out of 20 blocks are shown in this cutout view, shaded using different colors. This corresponds to the smallest decomposition of the computational domain, confined between two concentric spheres with \(r_{\mathrm{max}}/r_{\mathrm{min}}=2\), and using a single slab.
To formalize our communication strategy we define the concept of “exchange site” that could be a face, edge, or corner (vertex) of the block. Each exchange site maintains a list of blocks that share the site. The list consists of two elements for any face site, four for a tedge, six or five for an redge, and twelve or ten for a vertex site. Each site further defines a number of exchanges that occur at the site as lists of participant blocks. A block maintains a list of exchanges it needs to perform during a time step and its own order in that exchange. All exchanges of the same kind are started at once on every participating block in the nonblocking regime; we therefore rely on the message passing library’s own scheduling facilities to achieve optimal utilization of the interconnection network.
A block maintains a set of buffers and corresponding rules to pack a part of the block destined for exchange into contiguous memory of the buffer as well as the inverse (unpack) operation. Because neighboring blocks can have any of the three possible orientations, packing and unpacking must be done in a way that is independent of the choice of the base vertex. Care must also be taken to synchronize the variables at locations that are shared among blocks, such as facebased magnetic field values and fluxes, and edgebased electric fields. This synchronization is needed to eliminate possible divergence between neighboring blocks owing to roundoff errors.
Figure 13 shows the block surrounded by twelve neighbors that belong to the same slab. The large yellow triangle is the interior area of the block, while the surrounding smaller trapezoidal or triangular areas represent the receive buffers that correspond to the ghost zones of the block. To extract the data received from each neighbor from the corresponding buffer requires rotated TAS coordinates that are represented in Fig. 13 by pairs of black arrows showing the directions of the first and the second TAS coordinates, respectively. The convention for packing and unpacking a trapezoid is that the principal vertex is in the lower left corner with the trapezoid resting on its wider base. For small triangles, the principal vertex is the vertex shared with the block’s interior. This convention automatically ensures that unpacking of a buffer is done in the same order as it was packed by the neighbor block.
Figure 14 shows the structure of the complete simulation loop based on the Runge–Kutta time advance. The initial setup involving precomputing the geometry matrices is time consuming, but the subsequent computation is sped up dramatically as a result.
The production version of the code was written in Fortran, and a development version writen in C++ is also available. The input and output is handled by the open source SILO library (https://wci.llnl.gov/simulation/computercodes/silo). The library features a simple parallel I/O implementation that groups the blocks (which could number in the hundreds of thousands) into a smaller number of SILO files. An assembly file is then generated describing the relationship between the blocks for the visualizer. We use the VisIt visualizer (https://wci.llnl.gov/simulation/computercodes/visit) for 3D rendering of the model output; several of the figures in this paper were produced with VisIt.
Numerical tests
Here we present two simple tests validating the accuracy of the model. The first test in the “manufactured” solution of Ivan et al. (2013) that describes an interaction between a point source and a uniform flow; which is the most basic model of an astrosphere (an interface produced by a stellar wind expanding into a moving interstellar medium). This steady state, currentfree fieldaligned flow is given by
The source terms corresponding to Eqs. (59)–(62) that appear in the conservative MHD equations are
The analytic solution is independent of the adiabatic index γ. Following Ivan et al. (2013), the zerosubscripted constants are all set to unity, \(u_{1}/u_{0}=0.017\), \(\gamma =1.4\), and the simulation is performed in the region between \(r_{\mathrm{min}}=2\) and \(r_{\mathrm{max}}=3.5\). The radial shell width has an exponential dependence on r. Figure 15 shows the rate of convergence for the \(L_{1}\) and \(L_{\infty }\) norms of the error in the density, total energy and one component of the magnetic field. Simulations were performed on division 5 through division 8 meshes with 32 through 256 radial shells and the same number of zones per sector side.
As is demonstrated in Fig. 15, the \(L_{1}\) error decreases at the nominal convergence rate of the scheme in each case. The \(L_{\infty }\) norm displays the nominal convergence rate at second order, but decreases slower than the nominal rate and third and fourth order. This is further quantified in Tables 5 through 7 that show the numerical values of the order of convergence for the manufactured solution problem. The rates for density and energy (both zone based variables) are very similar, while magnetic field shows a different behavior. The imposition of constraints described in Sect. 7 affects the accuracy of reconstruction. It seems to be detrimental at lower order of accuracy but is surprisingly beneficial at fourth order.
Figure 16 shows the velocity magnitude (left panel) and the distribution of the error on the sphere at \(r=2.75\) for a simulation on a division 6 mesh using the fourth order scheme. The flow geometry resembles that of a potential flow of gas around a point source, although the velocity field is not irrotational here. The right panel shows the error distribution in one spherical layer. In common with other geodesic meshes, the error distribution shows a distinctive imprint of the mesh. The errors are the largest near the pentacorners and at the boundaries of division 0 and division 1 sectors. Similar phenomena have been reported by Tomita et al. (2001), Weller et al. (2012) and Peixoto and Barros (2013) in the context of the shallow water equations.
It is expected that the error becomes more concentrated near singular points with increasing refinement. For any division mesh, only 60 zones have a singular point as a vertex. Because the ratio of the number of large error zones to the total number of zones decreases with increased resolution, the \(L_{1}\) norm is not affected even if the convergence order in high error zones is one lower than elsewhere in the mesh; this is supported by the numbers from Table 7.
The second test is a timedependent blast problem from (Florinski et al. 2013). The initial conditions are piecewise constant within each of the two concentric shells, \(r_{\mathrm{min}}\leq r\leq r_{1}\) and \(r_{1}\leq r\leq r_{\mathrm{max}}\). Both states have \(\rho _{0}=1\) and \(\mathbf{u}_{0}=0\), while the pressure is set to \(p_{0}=10\) (\(r< r_{1}\)) and \(p_{0}=0.1\) (\(r>r_{1}\)). The initial magnetic field is a superposition of a dipole and a uniform fields,
We set \(\mathbf{B}_{0}=10/\sqrt{3}(\hat{\mathbf{e}}_{1}+\hat{\mathbf{e}}_{2}+ \hat{\mathbf{e}}_{3})\), \(\gamma =1.4\), and \(r_{1}=0.1\). The simulation was performed in the region between \(r_{\mathrm{min}}=r_{0}=0.01\) and \(r_{\mathrm{max}}=0.5\) until the time \(t=0.07\) with third order reconstruction on a division 6 mesh with 256 exponentially spaced radial shells. A reflective condition was used at the internal boundary and the fixed initial state maintained at the external boundary.
The magnetic field obtained for this problem is shown in Fig. 17. The flow consists of a fast shock wave and two dense shells of material elongated along the magnetic field. The result is in excellent agreement with that reported in Florinski et al. (2013).
Summary
This paper documents many of the original techniques and innovations that were incorporated into our newly developed computational model for MHD equations based on an icosahedral triangular geodesic mesh. The new geodesic framework features numerous improvements compared with our earlier icosahedral hexagonal model reported in Florinski et al. (2013) that was used successfully to simulate the interaction between the solar wind and the surrounding interstellar medium (Guo and Florinski 2016; Guo et al. 2018). These improvements are summarized below.
Triangle based mesh. Using triangles instead of hexagons paved the way to efficient decomposition of the computational domain into sectors in addition to radial shells (shell decomposition was the only one available in Florinski et al. (2013)). As a result, the new code scales up to tens of thousands of CPU cores with almost linear weak scaling (Balsara et al. 2019). The second advantage of the TGM is that it is amenable to adaptive mesh refinement, which is not possible with a hexagonal mesh.
Increased order of accuracy. The new framework provides second, third, and fourth orders of accuracy for the MHD equations. High accuracy was achieved by using larger stencils and multiple families of stencils including symmetric central and asymmetric directional stencils. This is a major improvement over our earlier geodesic model that was only second order capable. The only other fourth order geodesic mesh MHD model we are aware of was reported in Ivan et al. (2015); however it was based on a cubesphere rather than a TGM.
Accurate representation of spherical geometry. The new framework uses linear, quadratic, and cubic Lagrangian basis function to perform coordinate transformations from a reference element (a right prism) to the physical computational zone. These maps are based on the serendipity family of triangular finite elements with three, six, and ten nodes, respectively. This approach allows a very accurate representation of the spherical surface without the drawback of dealing directly with spherical coordinates. While the accuracy of the geometry representation does not improve the convergence order of the scheme, it could be potentially very important for the models of thin shells, such as planetary atmospheres.
Divergence free MHD. The new model features the first implementation of the constraint transport method on a geodesic mesh. In this approach the magnetic field is maintained divergence free because of exact cancellation of all contributions to divergence in a zone during the time update. In addition, the model features pointwise and functional divergencefree reconstruction of the magnetic field.
Implementation flexibility. All geodesic meshes are based on the same set of underlying principles used in mesh generation and spatial reconstruction. We have found that the present framework can be adapted, with a very limited number of changes, to build a model around any of the five regular polyhedra. We have developed an initial implementation of the geometry framework component for the hexahedral QGM. This will eventually permit a direct comparison between geodesic meshes of different types.
Abbreviations
 2D:

Two dimensional
 3D:

Three dimensional
 ADER:

Arbitrary high order scheme using Riemann problem to advect highorder Derivatives
 CFD:

Computational Fluid Dynamics
 CLSQ:

Constrained Least Square (system)
 CPU:

Central Processing Unit
 E:

East
 EF:

Edgeface (connectivity)
 ENC:

Exponential Normalized Coordinates
 EV:

Edgevertex (connectivity)
 FE:

Faceedge (connectivity)
 FF:

Faceface (connectivity)
 FV:

Facevertex (connectivity)
 HLL:

Harten–Lax–van Leer (Riemann solver)
 HLLC:

Harten–Lax–van Leer with Contact discontinuity (Riemann solver)
 HLLD:

Harten–Lax–van Leer with multiple Discontinuities (Riemann solver)
 HLLI:

Harten–Lax–van Leer with Intermediate characteristic fields (Riemann solver)
 KKT:

Karush–Kuhn–Tucker (matrix)
 LHS:

Left Hand Side
 LLS:

Linear Least Square (system)
 LU:

Lower–Upper
 MHD:

Magnetohydrodynamic
 MPI:

Message Passing Interface
 N:

North
 NE:

NorthEast
 NW:

NorthWest
 PDE:

Partial Differential Equation
 QGM:

Quadrilateral Geodesic Mesh
 RHS:

Right Hand Side
 S:

South
 SE:

SouthEast
 SI:

Système International
 SW:

SouthWest
 TAS:

Triangular Addressing Scheme
 TGM:

Triangular Geodesic Mesh
 TVD:

Total Variation Diminishing
 VE:

Vertexedge (connectivity)
 VF:

Vertexface (connectivity)
 VV:

Vertexvertex (connectivity)
 W:

West
 WENO:

Weighted Essentially NonOscillatory
 WENOAO:

Weighted Essentially NonOscillatory—Adaptive Order
References
Balsara, D.S.: Multidimensional HLLE Riemann solver: application to Euler and magnetohydrodynamic flows. J. Comput. Phys. 229, 1970–1993 (2010). https://doi.org/10.1016/j.jcp.2009.11.018
Balsara, D.S.: A twodimensional HLLC Riemann solver for conservation laws: application to Euler and magnetohydrodynamic flows. J. Comput. Phys. 231, 7476–7503 (2012). https://doi.org/10.1016/j.jcp.2011.12.025
Balsara, D.S.: Multidimensional Riemann problem with selfsimilar internal structure. Part I—application to hyperbolic conservation laws on structured meshes. J. Comput. Phys. 277, 163–200 (2014). https://doi.org/10.1016/j.jcp.2014.07.053
Balsara, D.S., Dumbser, M.: Divergencefree MHD on unstructured meshes using high order finite volume schemes based on multidimensional Riemann solvers. J. Comput. Phys. 299, 687–715 (2015a). https://doi.org/10.1016/j.jcp.2015.07.012
Balsara, D.S., Dumbser, M.: Multidimensional Riemann problem with selfsimilar internal structure. Part II—application to hyperbolic conservation laws on unstructured meshes. J. Comput. Phys. 287, 269–292 (2015b). https://doi.org/10.1016/j.jcp.2014.11.004
Balsara, D.S., Florinski, V., Garain, S., Subramanian, S., Gurski, K.F.: Efficient, divergencefree, high order MHD on 3D spherical meshes with optimal geodesic meshing. Mon. Not. R. Astron. Soc. 487, 1283–1314 (2019). https://doi.org/10.1093/mnras/stz1263
Balsara, D.S., Garain, S., Florinski, V., Boscheri, W.: An efficient class of WENO schemes with adaptive order for unstructured meshes. J. Comput. Phys. 404, 109062 (2020). https://doi.org/10.1016/j.jcp.2019.109062
Balsara, D.S., Garain, S., Shu, C.W.: An efficient class of WENO schemes with adaptive order. J. Comput. Phys. 326, 780–804 (2016). https://doi.org/10.1016/j.jcp.2016.09.009
Balsara, D.S., Rumpf, T., Dumbser, M., Munz, C.D.: Efficient, high accuracy ADERWENO schemes for hydrodynamics and divergencefree magnetohydrodynamics. J. Comput. Phys. 228, 2480–2516 (2009). https://doi.org/10.1016/j.jcp.2008.12.003
Balsara, D.S., Shu, C.W.: Monotonicity peserving weighted essentially nonoscillatory schemes with increasingly high order of accuracy. J. Comput. Phys. 160, 405–452 (2000). https://doi.org/10.1006/jcph.2000.6443
Balsara, D.S., Spicer, D.S.: A staggered mesh algorithm using high order Godunov fluxes to ensure solenoidal magnetic fields in magnetohydrodynamic simulations. J. Comput. Phys. 149, 270–292 (1999)
Batten, P., Clarke, N., Lambert, C., Causon, D.M.: On the choice of wavespeeds for the HLLC Riemann solver. SIAM J. Sci. Comput. 18, 1553–1570 (1997)
Beckmann, J., Mhaskar, H.N., Prestin, J.: Quadrature formulas for integration of multivariate trigonometric polynomials on spherical triangles. GEM Int. J. Geomath. 3, 119–138 (2012). https://doi.org/10.1007/s1313701200354
Bernard, P.E., Remacle, J.F., Comblen, R., Legat, V., Hillewaert, K.: Highorder discontinuous Galerkin schemes on general 2D manifolds applied to the shallow water equations. J. Comput. Phys. 228, 6514–6535 (2009). https://doi.org/10.1016/j.jcp.2009.05.046
Browning, G.L., Hack, J.J., Swarztrauber, P.N.: A comparison of three numerical methods for solving differential equations on the sphere. Mon. Weather Rev. 117, 1058–1075 (1989)
Choblet, G., Čadek, O., Couturier, F., Dumoulin, C.: ŒDIPUS: a new tool to study the dynamics of planetary interiors. Geophys. J. Int. 170, 9–30 (2007). https://doi.org/10.1111/j.1365246X.2007.03419.x
DeVore, C.R.: Fluxcorrected transport trchniques for multidimensional compressible magnetohydrodynamics. J. Comput. Phys. 92, 142–160 (1991)
Du, Q., Faber, V., Gunzburger, M.: Centroidal Voronoi tessellations: applications and algorithms. SIAM Rev. 41, 637–676 (1999)
Du, Q., Gunzburger, M.D., Ju, L.: Voronoibased finite volume methods, optimal Voronoi meshes, and PDEs on the sphere. Comput. Methods Appl. Mech. Eng. 192, 3933–3957 (2003). https://doi.org/10.1016/S00457825(03)003943
Dumbser, M., Balsara, D.S.: A new efficient formulation of the HLLEM Riemann solver for general conservative and nonconservative hyperbolic systems. J. Comput. Phys. 304, 275–319 (2016). https://doi.org/10.1016/j.jcp.2015.10.014
Dumbser, M., Balsara, D.S., Toro, E.F., Munz, C.D.: A unified framework for the construction of onestep finite volume and discontinuous Galerkin schemes on unstructured meshes. J. Comput. Phys. 227, 8209–8253 (2008). https://doi.org/10.1016/j.jcp.2008.05.025
Dumbser, M., Käser, M.: Arbitrary high order nonoscillatory finite volume schemes on unstructured meshes for linear hyperbolic systems. J. Comput. Phys. 221, 693–723 (2007). https://doi.org/10.1016/j.jcp.2006.06.043
Dunavant, D.A.: High degree efficient symmetrical Gaussian quadrature rules for the triangle. Int. J. Numer. Methods Eng. 21, 1129–1148 (1985)
Einfeldt, B.: On Godunovtype methods for gas dynamics. SIAM J. Numer. Anal. 25, 294–318 (1988)
Evans, C.R., Hawley, J.F.: Simulation of magnetohydrodynamic flows—a constrained transport method. Astrophys. J. 332, 659–677 (1988). https://doi.org/10.1086/166684
Feng, X., Yang, L., Xiang, C., Wu, S.T., Zhou, Y., Zhong, D.: Threedimensional solar wind modeling from the Sun to Earth by a SIPCESE MHD model with a sixcomponent grid. Astrophys. J. 723, 300–319 (2010). https://doi.org/10.1088/0004637X/723/1/300
Feng, X., Zhou, Y., Wu, S.T.: A novel numerical implementation for solar wind modeling by the modified conservation element/solution wlement method. Astrophys. J. 655, 1110–1126 (2007). https://doi.org/10.1086/510121
Florinski, V., Guo, X., Balsara, D.S., Meyer, C.: Magnetohydrodynamic modeling of solar system processes on geodesic grids. Astrophys. J. Suppl. Ser. 205, 19 (2013). https://doi.org/10.1088/00670049/205/2/19
Friedrich, O.: Weighted essentially nonoscillatory schemes for the interpolation of mean values on unstructured grids. J. Comput. Phys. 144, 194–212 (1998)
Giraldo, F.X.: Lagrange–Galerkin methods on spherical geodesic grids. J. Comput. Phys. 136, 197–213 (1997)
Gorski, K.M., Hivon, E., Banday, A.J., Wandelt, B.D., Hansen, F.K., Reinecke, M., Bartelmann, M.: HEALPix: a framework for highresolution discretization and fast analysis of data distributed on the sphere. Astrophys. J. 622, 759–771 (2005). https://doi.org/10.1086/427976
Guo, X., Florinski, V.: Galactic cosmicray intensity modulation by corotating interaction region stream interfaces at 1 AU. Astrophys. J. 826, 65 (2016). https://doi.org/10.3847/0004637X/826/1/65
Guo, X., Florinski, V., Wang, C.: Effects of anomalous cosmic rays on the structure of the outer heliosphere. Astrophys. J. 859, 157 (2018). https://doi.org/10.3847/15384357/aabf42
Gurski, K.F.: An HLLCtype approximate Riemann solver for ideal magnetohydrodynamics. SIAM J. Sci. Comput. 25, 2165–2187 (2004). https://doi.org/10.1137/S1064827502407962
Harten, A., Lax, P.D., van Leer, B.: On upstream differencing and Godunovtype schemes for hyperbolic conservation laws. SIAM Rev. 25, 35–61 (1983)
Harten, A., Osher, S.: Uniformly highorder accurate nonoscillatory schemes. I. SIAM J. Numer. Anal. 2, 279–309 (1987)
Heikes, R., Randall, D.A.: Numerical integration of the shallowwater equations on a twisted icosahedral grid. Part I. Basic design and results of tests. Mon. Weather Rev. 123, 1862–1880 (1995a)
Heikes, R., Randall, D.A.: Numerical integration of the shallowwater equations on a twisted icosahedral grid. Part II. A detailed description of the grid and an analysis of numerical accuracy. Mon. Weather Rev. 123, 1881–1887 (1995b)
Ivan, L., De Sterck, H., Northrup, S.A., Groth, C.P.T.: Multidimensional finitevolume scheme for hyperbolic conservation laws on threedimensional solutionadaptive cubedsphere grids. J. Comput. Phys. 255, 205–227 (2013). https://doi.org/10.1016/j.jcp.2013.08.008
Ivan, L., De Sterck, H., Susanto, A., Groth, C.P.T.: Highorder central ENO finitevolume scheme for hyperbolic conservation laws on threedimensional cubedsphere grids. J. Comput. Phys. 282, 157–182 (2015). https://doi.org/10.1016/j.jcp.2014.11.002
Jiang, G.S., Shu, C.W.: Efficient implementation of weighted ENO schemes. J. Comput. Phys. 126, 202–228 (1995)
Kageyama, A., Sato, T.: “Yin–Yang grid”: an overset grid in spherical geometry. Geochem. Geophys. Geosyst. 5, Q09005 (2004). https://doi.org/10.1029/2004GC000734
Käser, M., Iske, A.: ADER schemes on adaptive triangular meshes for scalar conservation laws. J. Comput. Phys. 205, 486–508 (2005). https://doi.org/10.1016/j.jcp.2004.11.015
Koldoba, A.V., Romanova, M.M., Ustyugova, G.V., Lovelace, R.V.E.: Threedimensional magnetohydrodynamic simulations of accretion to an inclined rotator: the “cubed sphere” method. Astrophys. J. 576, L53–L56 (2002)
Li, S.: An HLLC Riemann solver for magnetohydrodynamics. J. Comput. Phys. 203, 344–357 (2005). https://doi.org/10.1016/j.jcp.2004.08.020
Liu, X.D., Osher, S., Chan, T.: Weighted essentially nonoscillatory schemes. J. Comput. Phys. 115, 200–212 (1994)
Miura, H.: An upwindbiased conservative advection scheme for spherical hexagonal–pentagonal grids. Mon. Weather Rev. 135, 4038–4044 (2007). https://doi.org/10.1175/2007MWR2101.1
Miyoshi, T., Kusano, K.: A multistate HLL approximate Riemann solver for ideal magnetohydrodynamics. J. Comput. Phys. 208, 315–344 (2005). https://doi.org/10.1016/j.jcp.2005.02.017
Nakamizo, A., Tanaka, T., Kubo, Y., Kamei, S., Shimazu, H., Shinagawa, H.: Development of the 3D MHD model of the solar coronasolar wind combining system. J. Geophys. Res. 114, A07109 (2009). https://doi.org/10.1029/2008JA013844
OllivierGooch, C., Van Altena, M.: A highorderaccurate unstructured mesh finitevolume scheme for the advectiondiffusion equation. J. Comput. Phys. 181, 729–752 (2002). https://doi.org/10.1006/jcph.2002.7159
Peixoto, P.S., Barros, S.R.M.: Analysis of grid imprinting on geodesic spherical icosahedral grids. J. Comput. Phys. 237, 61–78 (2013). https://doi.org/10.1016/j.jcp.2012.11.041
Phillips, N.A.: Numerical integration of the primitive equations on the hemisphere. Mon. Weather Rev. 87, 333–345 (1959)
Pudykiewicz, J.A.: Numerical solution of the reactionadvectiondiffusion equation on the sphere. J. Comput. Phys. 213, 358–390 (2006). https://doi.org/10.1016/j.jcp.2005.08.021
Putman, W.M., Lin, S.J.: Finitevolume transport on various cubedsphere grids. J. Comput. Phys. 227, 55–78 (2007). https://doi.org/10.1016/j.jcp.2007.07.022
Ronchi, C., Iacono, R., Paolucci, P.S.: The “cubed sphere”: a new method for the solution of partial differential equations in spherical geometry. J. Comput. Phys. 124, 93–114 (1996)
Ryu, D., Miniati, F., Jones, T.W., Frank, A.: A divergencefree upwind code for multidimensional magnetohydrodynamic flows. Astrophys. J. 509, 244–255 (1998)
Sadourny, R., Arakawa, A., Mintz, Y.: Integration of the nondivergent barotropic vorticity equation with an icosahedralhexagonal grid for the sphere. Mon. Weather Rev. 96, 351–356 (1968)
Shu, C.W., Osher, S.: Efficient implementation of essentially nonoscillatory shockcapturing schemes. J. Comput. Phys. 77, 439–471 (1988). https://doi.org/10.1016/00219991(88)901775
Tomita, H., Tsugawa, M., Satoh, M., Goto, K.: Shallow water model on a modified icosahedral geodesic grid by using spring dynamics. J. Comput. Phys. 174, 579–613 (2001). https://doi.org/10.1006/jcph.2001.6897
Ullrich, P.A., Taylor, M.A.: Arbitraryorder conservative and consistent remapping and a theory of linear maps: part I. Mon. Weather Rev. 143, 2419–2440 (2015). https://doi.org/10.1175/MWRD1400343.1
Usmanov, A.V., Goldstein, M.L., Matthaeus, W.H.: Threedimensional magnetohydrodynamic modeling of the solar wind including pickup protons and turbulence transport. Astrophys. J. 754, 40 (2012). https://doi.org/10.1088/0004637X/754/1/40
Weller, H., Thuburn, J., Cotter, C.J.: Computational modes and grid imprinting on five quasiuniform spherical C grids. Mon. Weather Rev. 140, 2734–2755 (2012). https://doi.org/10.1175/MWRD1100193.1
Zienkiewicz, O.C., Taylor, R.L., Zhu, J.Z.: The Finite Element Method: Its Basis and Fundamentals, vol. 1, 5th edn. Butterworth, Oxford (2013)
Acknowledgements
Not applicable.
Availability of data and materials
Data used to produce the figures in this paper are available from the authors on request.
Funding
This work was supported, in part, by NSF grant DMS1361219 and by NASA grant NNX17AB85G. DBS acknowledges support via NSF grants ACI1533850, DMS1622457, ACI1713765 and DMS1821242. Support from a grant by Notre Dame International is also acknowledged.
Author information
Affiliations
Contributions
VF codeveloped the mathematical models, implemented them in a C++ code, and wrote most of the paper. DSB codeveloped the mathematical models and designed the Fortran version of the code. SG wrote parts of the Fortran code and performed test simulations. KFG developed numerical quadrature algorithms used by the code. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare that they have no competing interests.
Appendices
Appendix A: Basis functions for triangular faces
Linear elements: nodal points at vertices,
Quadratic elements: nodal points at vertices and edge midpoints,
Cubic elements: nodal points at vertices, edge thirds, and geometric center,
Appendix B: Reconstruction accuracy vs. stencil size
To determine whether the stencil configuration affects the accuracy of the reconstructed solution, we conducted a statistical test by initializing a single grid block with an ensemble of \(N_{w}=10\) waves with isotropically distributed wavevectors \(\mathbf{k}_{j}\) and random phases \(\varphi _{j}\),
where U is the scalar variable to be reconstructed. The wavelengths \(\lambda _{j}=2\pi /k_{j}\) were logarithmically distributed between \(\lambda _{\mathrm{min}}=1\) and \(\lambda _{\mathrm{max}}=10\). For this test we used fourth order of accuracy because it offers the largest choice of stencils. A single division 1 block with 16 shells, \(r_{\mathrm{min}}=1.71\), \(r_{\mathrm{max}}=2.92\), and division 5 tfaces was used. Shell spacing was exponential as given by Eq. (27).
Figure 18 shows the average \(L_{1}\) error, its standard deviation, and the largest error over all trials, as a function of the number of zones in the stencil that varied between \(D(3)=20\) and \(3D(3)=60\). Interestingly, both the average and the maximum errors are slowly increasing with the stencil size, although a zero trend would also be consistent with the error bars. This trend was previously observed by Ivan et al. (2015), who suggested that smaller stencils provide higher accuracy because the reconstruction data is more local to the zone. The only exception is the first point corresponding to the stencil of the smallest possible size. It would seem reasonable, then, to use smaller stencils as long as they have a few extra zones to benefit from the least square procedure. One has to remember, however, that this result may not hold for every problems or mesh configuration.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Florinski, V., Balsara, D.S., Garain, S. et al. Technologies for supporting highorder geodesic mesh frameworks for computational astrophysics and space sciences. Comput. Astrophys. Cosmol. 7, 1 (2020). https://doi.org/10.1186/s40668020000337
Received:
Accepted:
Published:
Keywords
 Geodesic mesh
 Finite volume scheme
 Divergence free MHD