Superscopes: Amplifying Internal Feature Representations for Language Model Interpretation
Jonathan Jacobi, Gal Niv
Understanding and interpreting the internal representations of large language models (LLMs) remains an open challenge. Patchscopes introduced a method for probing internal activations by patching them into new prompts, prompting models to self-explain their hidden representations. We introduce Superscopes, a technique that systematically amplifies superposed features in MLP outputs (multilayer perceptron) and hidden states before patching them into new contexts. Inspired by the "features as directions" perspective and the Classifier-Free Guidance (CFG) approach from diffusion models, Superscopes amplifies weak but meaningful features, enabling the interpretation of internal representations that previous methods failed to explain-all without requiring additional training. This approach provides new insights into how LLMs build context and represent complex concepts, further advancing mechanistic interpretability.
Quantifying the Impact of Missing Risk Markets for Decarbonized Power Systems with Long Duration Energy Storage
Andreas C. Makrides, Adam Suski, Elina Spyrou
The transition to a fully decarbonised electricity system depends on integrating new technologies that ensure reliability alongside sustainability. However, missing risk markets hinder investment in reliability-enhancing technologies by exposing investors to revenue uncertainty. This study provides the first quantitative assessment of how missing risk markets affect investment decisions in power systems that depend on long-duration energy storage (LDES) for reliability. We develop a two-stage stochastic equilibrium model with risk-averse market participants, which independently sizes power and energy capacity. We apply the method to a case study of a deeply decarbonised power system in Great Britain. The results show that incomplete risk markets reduce social welfare, harm reliability, and discourage investment in LDES and other technologies with volatile revenue streams. Revenue volatility leads to substantial risk premiums and higher financing costs for LDES, creating a barrier to its large-scale deployment. These findings demonstrate the importance of policy mechanisms that hedge revenue risk to lower the cost of capital and accelerate investment in reliability-enhancing, zero-carbon technologies
The First Impression Problem: Internal Bias Triggers Overthinking in Reasoning Models
Renfei Dang, Zhening Li, Shujian Huang
et al.
Reasoning models often exhibit overthinking, characterized by redundant reasoning steps. We identify \emph{internal bias} elicited by the input question as a key trigger of such behavior. Upon encountering a problem, the model immediately forms a preliminary guess about the answer, which we term an internal bias since it may not be explicitly generated, and it arises without systematic reasoning. When this guess conflicts with its subsequent reasoning, the model tends to engage in excessive reflection, resulting in wasted computation. We validate the association between internal bias and overthinking across multiple models and diverse reasoning tasks. To demonstrate the causal relationship more rigorously, we conduct two counterfactual interventions, showing that removing the input question after the model reduces the redundant reasoning across various complex reasoning tasks, and manually injecting bias affects overthinking accordingly. Further interpretability experiments suggest that excessive attention to the input question serves as a key mechanism through which internal bias influences subsequent reasoning trajectories. Finally, we evaluated several methods aimed at mitigating overthinking, yet the influence of internal bias persisted under all conditions.
On internal categories and crossed objects in the category of monoids
Ilia Pirashvili
It is a well-known fact that the category $\mathsf{Cat}(\mathbf{C})$ of internal categories in a category $\mathbf{C}$ has a description in terms of crossed modules, when $\mathbf{C}=\mathbf{Gr}$ is the category of groups. The proof of this result heavily uses the fact that any split epimorphism decomposes as a semi-direct product. An equivalent statement does not hold in the category $\mathbf{Mon}$ of monoids. In a previous work on quadratic algebras, I constructed an internal category in the category of monoids, see Section 6. Based on this construction, this paper will introduce the notion of a crossed semi-bimodule and show that it gives rise to an object in $\mathsf{Cat}(\mathbf{Mon})$. I will also relate this new notion to the crossed semi-modules introduced earlier by A. Patchkoria.
Defection-Free Collaboration between Competitors in a Learning System
Mariel Werner, Sai Praneeth Karimireddy, Michael I. Jordan
We study collaborative learning systems in which the participants are competitors who will defect from the system if they lose revenue by collaborating. As such, we frame the system as a duopoly of competitive firms who are each engaged in training machine-learning models and selling their predictions to a market of consumers. We first examine a fully collaborative scheme in which both firms share their models with each other and show that this leads to a market collapse with the revenues of both firms going to zero. We next show that one-sided collaboration in which only the firm with the lower-quality model shares improves the revenue of both firms. Finally, we propose a more equitable, *defection-free* scheme in which both firms share with each other while losing no revenue, and we show that our algorithm converges to the Nash bargaining solution.
Kinetic equation for weak interaction of directional internal waves
Michal Shavit, Oliver Bühler, Jalal Shatah
Starting from the two-dimensional Boussinesq equation without rotation, we derive a kinetic equation for weak interaction of internal waves using non-canonical variables. We follow a formalism introduced by P. Ripa in the 80's. The advantage of this formalism is that it describes the system in terms of the natural linear eigenfunctions of eastward and westward propagating internal waves. Using properties of orthogonality of the eigenfunctions with respect to a (pseudo) metric set by the energy we can write non perturbative theory for the interaction of waves given in terms of the expansion amplitudes. The evolution is controlled by a system of equations, with quadratic nonlinearity, which is an exact representation of the original model equations. The dynamics is constrained by the conservation of energy and pseudo-momentum, which can be written simply as a linear combination of the squared absolute value of the amplitudes. The possibility of a generalization of the Fjortoft's argument to internal gravity waves and observation of a non trivial double cascade of energy and pseudo-momentum is discussed.
en
physics.flu-dyn, math-ph
Escaping Cannibalization? Correlation-Robust Pricing for a Unit-Demand Buyer
Moshe Babaioff, Michal Feldman, Yannai A. Gonczarowski
et al.
We consider a robust version of the revenue maximization problem, where a single seller wishes to sell $n$ items to a single unit-demand buyer. In this robust version, the seller knows the buyer's marginal value distribution for each item separately, but not the joint distribution, and prices the items to maximize revenue in the worst case over all compatible correlation structures. We devise a computationally efficient (polynomial in the support size of the marginals) algorithm that computes the worst-case joint distribution for any choice of item prices. And yet, in sharp contrast to the additive buyer case (Carroll, 2017), we show that it is NP-hard to approximate the optimal choice of prices to within any factor better than $n^{1/2-ε}$. For the special case of marginal distributions that satisfy the monotone hazard rate property, we show how to guarantee a constant fraction of the optimal worst-case revenue using item pricing; this pricing equates revenue across all possible correlations and can be computed efficiently.
Structural evolution of binary oxide nanolaminates with annealing and its impact on room-temperature internal friction
Le Yang, Mariana Fazio, Gabriele Vajente
et al.
Internal friction in oxide thin films imposes a critical limitation to the sensitivity and stability of ultra-high finesse optical cavities for gravitational wave detectors. Strategies like doping or creating nanolaminates are sought to introduce structural modifications that reduce internal friction. This work describes an investigation of the morphological changes SiO2/Ta2O5 and TiO2/Ta2O5 nanolaminates undergo with annealing and their impact on room temperature internal friction. It is demonstrated that thermal treatment results in a reduction of internal friction in both nanolaminates, but through different pathways. In the SiO2/Ta2O5 nanolaminate, which layers remain intact after annealing, the total reduction in internal friction follows the reduction in the composing SiO2 and Ta2O5 layers. Instead, interdiffusion initiated by annealing at the interface of the TiO2/Ta2O5 nanolaminate and the formation of a mixed phase dictate a more significant reduction in internal friction to ~ 2.6 * 10-4, a value lower than any other Ta2O5 mixture coating with similar cation concentration.
Hyper-local sustainable assortment planning
Nupur Aggarwal, Abhishek Bansal, Kushagra Manglik
et al.
Assortment planning, an important seasonal activity for any retailer, involves choosing the right subset of products to stock in each store.While existing approaches only maximize the expected revenue, we propose including the environmental impact too, through the Higg Material Sustainability Index. The trade-off between revenue and environmental impact is balanced through a multi-objective optimization approach, that yields a Pareto-front of optimal assortments for merchandisers to choose from. Using the proposed approach on a few product categories of a leading fashion retailer shows that choosing assortments with lower environmental impact with a minimal impact on revenue is possible.
In-beam internal conversion electron spectroscopy with the SPICE detector
M. Moukaddam, J. Smallcombe, L. J. Evitts
et al.
The SPectrometer for Internal Conversion Electrons (SPICE) has been commissioned for use in conjunction with the TIGRESS $γ$-ray spectrometer at TRIUMF's ISAC-II facility. SPICE features a permanent rare-earth magnetic lens to collect and direct internal conversion electrons emitted from nuclear reactions to a thick, highly segmented, lithium-drifted silicon detector. This arrangement, combined with TIGRESS, enables in-beam $γ$-ray and internal conversion electron spectroscopy to be performed with stable and radioactive ion beams. Technical aspects of the device, capabilities, and initial performance are presented.
Actor of categories internal to groups
Tunçar Şahan
In this study, using the Brown-Spencer theorem and in the ligth of the works of Norrie, in the category of internal categories within groups, also called group-groupoids, we interpret the notion of actor of a crossed module over groups. Further, we construct the action of a group-groupoid on a group-groupoid. Moreover, we give the explicit construction of semi-direct product of two group-groupoids and of holomorph of group-groupoids.
Validation of Internal Meters of Mobile Android Devices
Mahmoud A. Bokhari, Yuanzhong Xia, Bo Zhou
et al.
In this paper we outline our results for validating the precision of the internal power meters of smart-phones under different workloads. We compare its results with an external power meter. This is the first step towards creating customized energy models on the fly and towards optimizing battery efficiency using genetic program improvements. Our experimental results indicate that the internal meters are sufficiently precise when large enough time windows are considered. This is part of our work on the "dreaming smart-phone". For a technical demonstration please watch our videos https://www.youtube.com/watch?v=xeeFz2GLFdU and https://www.youtube.com/watch?v=C7WHoLW1KYw.
Frustration-induced internal stresses are responsible for quasilocalized modes in structural glasses
Edan Lerner, Eran Bouchbinder
It has been recently shown [E. Lerner, G. Düring, and E. Bouchbinder, Phys. Rev. Lett. 117, 035501 (2016)] that the non-phononic vibrational modes of structural glasses at low-frequencies $ω$ are quasi-localized and follow a universal density of states $D(ω)\!\sim\!ω^4$. Here we show that the gapless nature of the observed density of states depends on the existence of internal stresses which generically emerge in glasses due to frustration, thus elucidating a basic element underlying this universal behavior. Similarly to jammed particulate packings, low-frequency modes in structural glasses emerge from a balance between a local elasticity term and an internal stress term in the dynamical matrix, where the difference between them is orders of magnitude smaller than their typical magnitude. By artificially reducing the magnitude of internal stresses in a computer glass former in three dimensions, we show that a gap is formed in the density of states below which no vibrational modes exist, thus demonstrating the crucial importance of internal stresses. Finally, we show that while better annealing the glass upon cooling from the liquid state significantly reduces its internal stresses, the self-organizational processes during cooling render the gapless $D(ω)\!\sim\!ω^4$ density of state unaffected.
Growth, Development Outcome and Fiscal Balance: How Have Indian States Performed?
P. Chakraborty
Heuristic algorithms for the operator-based relocation problem in one-way electric carsharing systems
Maurizio Bruglieri, Ferdinando Pezzella, Ornella Pisacane
This paper addresses an Electric Vehicle Relocation Problem (E-VReP), in one-way carsharing systems, based on operators who move through folding bicycles between a delivery request and one of pickup. In order to deal with its economical sustainability, a revenue associated with each relocation request satisfied and a cost due to each operator used are introduced. The new optimization objective maximizes the total profit. To overcome the drawback due to the high CPU time required by the Mixed Integer Linear Programming formulation of the E-VReP, four heuristics, also based on general properties of the feasible solutions, are designed. Their effectiveness is tested on two sets of realistic instances. In the first one, all the requests have the same revenue. In the second one, the revenue of each request has a variable component related to the user's rent-time and a fixed one related to the customer satisfaction. Finally, a sensitivity analysis is carried out on both the number of requests and the fixed revenue component.
Performance of internal Covariance Estimators for Cosmic Shear Correlation Functions
O. Friedrich, S. Seitz, T. F. Eifler
et al.
Data re-sampling methods such as the delete-one jackknife are a common tool for estimating the covariance of large scale structure probes. In this paper we investigate the concepts of internal covariance estimation in the context of cosmic shear two-point statistics. We demonstrate how to use log-normal simulations of the convergence field and the corresponding shear field to carry out realistic tests of internal covariance estimators and find that most estimators such as jackknife or sub-sample covariance can reach a satisfactory compromise between bias and variance of the estimated covariance. In a forecast for the complete, 5-year DES survey we show that internally estimated covariance matrices can provide a large fraction of the true uncertainties on cosmological parameters in a 2D cosmic shear analysis. The volume inside contours of constant likelihood in the $Ω_m$-$σ_8$ plane as measured with internally estimated covariance matrices is on average $\gtrsim 85\%$ of the volume derived from the true covariance matrix. The uncertainty on the parameter combination $Σ_8 \sim σ_8 Ω_m^{0.5}$ derived from internally estimated covariances is $\sim 90\%$ of the true uncertainty.
EURO AREA FISCAL STRUCTURES. A MULTIVARIATE ANALYSIS
G. Hurduzeu, I. Lazar
PELAKSANAAN REFORMASI BIROKRASI DALAM RANGKA MENINGKATKAN PENERIMAAN PAJAK DI KANTOR WILAYAH DIREKTORAT JENDERAL PAJAK JAWA TENGAH I
Suwandoko Suwandoko
1 sitasi
en
Political Science
CONTRIBUTION OF INDIRECT TAXES TOWARDS CREATION OF STATE REVENUES IN ROMANIA
Holt Gheorghe
Deconstructing the Haig-Simons Income Tax and Reconstructing It as Objective Ability-to-Pay 'Cash Income' Tax
Joseph M. Dodge