Aggregate shape properties, such as form, angularity, and surface texture, highly influence the performance of hot-mix asphalt (HMA). Rutting is related to aggregate angularity and form, which affects the interlock among particles. Fatigue cracking can be decreased by an aggregate rough surface texture, which improves the aggregate-binder interaction. Several researchers have been studying new automated and more precise techniques, such as the aggregate image measurement system (AIMS), to improve the determination of aggregate shape parameters. This paper presents an analysis of aggregates from three different mineralogical sources, investigating the influence of shape properties on HMA design and mechanical properties. The results indicated that the aggregates had similar shape properties, despite differences in the mineralogical composition. This might be a direct effect of similar quarrying procedures. Surface texture resulted in different values, which can be explained by results from the petrographic analyses. In general, the aggregates’ shape properties resulted in HMA samples with similar mechanical behavior. The HMA specimens were also analyzed in terms of their internal structure, which included the investigation of a number of contact points, and aggregate particles’ segregation and orientation characteristics.