Speculative Speculative Decoding
Tanishq Kumar, Tri Dao, Avner May
Autoregressive decoding is bottlenecked by its sequential nature. Speculative decoding has become a standard way to accelerate inference by using a fast draft model to predict upcoming tokens from a slower target model, and then verifying them in parallel with a single target model forward pass. However, speculative decoding itself relies on a sequential dependence between speculation and verification. We introduce speculative speculative decoding (SSD) to parallelize these operations. While a verification is ongoing, the draft model predicts likely verification outcomes and prepares speculations pre-emptively for them. If the actual verification outcome is then in the predicted set, a speculation can be returned immediately, eliminating drafting overhead entirely. We identify three key challenges presented by speculative speculative decoding, and suggest principled methods to solve each. The result is Saguaro, an optimized SSD algorithm. Our implementation is on average 30% faster than optimized speculative decoding baselines and up to 5x faster than autoregressive decoding with open source inference engines.
Speculative Decoding with a Speculative Vocabulary
Miles Williams, Young D. Kwon, Rui Li
et al.
Speculative decoding has rapidly emerged as a leading approach for accelerating language model (LM) inference, as it offers substantial speedups while yielding identical outputs. This relies upon a small draft model, tasked with predicting the outputs of the target model. State-of-the-art speculative decoding methods use a draft model consisting of a single decoder layer and output embedding matrix, with the latter dominating drafting time for the latest LMs. Recent work has sought to address this output distribution bottleneck by reducing the vocabulary of the draft model. Although this can improve throughput, it compromises speculation effectiveness when the target token is out-of-vocabulary. In this paper, we argue for vocabulary speculation as an alternative to a reduced vocabulary. We propose SpecVocab, an efficient and effective method that selects a vocabulary subset per decoding step. Across a variety of tasks, we demonstrate that SpecVocab can achieve a higher acceptance length than state-of-the-art speculative decoding approach, EAGLE-3. Notably, this yields up to an 8.1% increase in average throughput over EAGLE-3.
THE INFLUENCE OF MODERN MASS MEDIA AND SOCIAL NETWORKS ON THE SPREAD OF MANIPULATIVE CONTENT IN THE INFORMATION SPACE: THE UKRAINIAN CONTEXT
Катерина УШКАЛО
The article analyzes the interrelation between the components of mass media (mass information and mass communication) and social networks in the context of their influence on users’ perception and trust in information. The theoretical research focuses on identifying the features of the functioning of the modern media space, where traditional mass media increasingly intertwine with digital technologies, creating new opportunities for content dissemination but also generating new risks.
The purpose of the study is to analyze the impact of new media, particularly social networks, on the spread of manipulative content such as fake news, disinformation, and emotional narratives in the national information space of Ukraine.
The article emphasizes that the development of digital technologies has significantly changed society’s attitude toward searching for and processing information, especially after the full-scale invasion of Russian troops into Ukraine.
The popularity of social networks compared to other mass media has been analyzed, and the factors contributing to the spread of manipulative information have been identified, including: algorithm-based content promotion, the «echo chamber» effect, the mass use of digital bots, the application of artificial intelligence technologies, the spread of memes and visual narratives, as well as the growing activity of Telegram channels and alternative media platforms following the decline in trust toward traditional media.
It is substantiated that despite the gradual decline in trust in social networks, users continue to actively consume news from these sources, valuing their speed, convenience, and the ability to independently select and filter information. Such a trend increases citizens’ vulnerability to informational manipulation, weakens the information resilience of society, and poses security risks to the state.
The obtained results provide a deeper understanding of the mechanisms of public opinion formation in the context of digitalization and highlight the need to enhance critical thinking and media literacy at the national level.
Epistemology. Theory of knowledge
POLITICAL MECHANISM IN THE REALIZATION OF SUSTAINABLE DEVELOPMENT GOALS IN THE SYSTEM OF LOCAL GOVERNMENT
Микола БОГАЧЕНКО
The study aims to analyze the political mechanisms essential for the effective realization of Sustainable Development Goals (SDGs) within the local government framework. The research employs a mixed-method approach, combining qualitative and quantitative analyses to evaluate the interaction between local self-government bodies (LSGs) and businesses, improving investment resources, and directing investment capital towards human resources. The study reveals that the peculiarities of implementing SDGs in Ukraine involve ensuring the stabilizing and distributive functions of the state, which contribute to stimulating economic growth and efficient resource allocation. A new paradigm of local self-government is proposed, characterized by minimal state intervention in regional economies.
The results highlight the importance of decentralization and the empowerment of local authorities, aiming to enhance the efficiency and responsiveness of local governance. The study identifies that fostering closer collaboration between local governments and businesses creates a conducive environment for economic development and innovation. Human capital development, through directing investment capital towards education, training, and skill development, is found to enhance the productivity and competitiveness of the local workforce, attracting more investment and creating new job opportunities.
The research underscores the significance of international cooperation in achieving SDGs, encouraging local enterprises to engage in international projects and partnerships to leverage global expertise and resources. Innovative financing mechanisms, including public-private partnerships and impact investing, are proposed to support local development initiatives, aiming to reduce dependency on state budgets and enhance financial sustainability.
Theoretical implications suggest that the proposed model can be applied to other regions with similar economic and governance structures. Practically, the study offers actionable insights for policymakers and local governments to design strategies for sustainable local development. The originality of the research lies in its comprehensive approach, integrating political, economic, and social dimensions of sustainable development at the local level.
Further research should explore the long-term impacts of these mechanisms and address potential limitations related to varying regional contexts. This empirical study provides a foundation for future studies on sustainable development in local governance.
Epistemology. Theory of knowledge
Decoding Speculative Decoding
Minghao Yan, Saurabh Agarwal, Shivaram Venkataraman
Speculative Decoding is a widely used technique to speed up inference for Large Language Models (LLMs) without sacrificing quality. When performing inference, speculative decoding uses a smaller draft model to generate speculative tokens and then uses the target LLM to verify those draft tokens. The speedup provided by speculative decoding heavily depends on the choice of the draft model. In this work, we perform a detailed study comprising over 350 experiments with LLaMA-65B and OPT-66B using speculative decoding and delineate the factors that affect the performance gain provided by speculative decoding. Our experiments indicate that the performance of speculative decoding depends heavily on the latency of the draft model, and the draft model's capability in language modeling does not correlate strongly with its performance in speculative decoding. Based on these insights we explore a new design space for draft models and design hardware-efficient draft models for speculative decoding. Our newly designed draft model can provide 111% higher throughput than existing draft models and our approach generalizes further to all LLaMA models (1/2/3.1) and supervised fine-tuned models.
The Next Generation Event Horizon Telescope Collaboration: History, Philosophy, and Culture
Peter Galison, Juliusz Doboszewski, Jamee Elder
et al.
This white paper outlines the plans of the History Philosophy Culture Working Group of the Next Generation Event Horizon Telescope Collaboration.
en
physics.hist-ph, astro-ph.GA
Bohr's Anti-Realist Realism in Contemporary (Quantum) Physics and Philosophy
Christian de Ronde
We discuss the influential role of Niels Bohr's work in the anti-realist realist re-foundation of physics that took place during the 20th century. We will focus in how, developing the modern co-relational matrix of scientific understanding, his essentially anti-realist scheme was able to capture, subvert and defeat the realist program of science through the establishment of a weakened impotent form of "religious realism" grounded on faith instead of scientific conditions. Finally, we will focus in how, still today, anti-realist realism continues to rule the contemporary post-modern research in both (quantum) physics and philosophy.
en
physics.hist-ph, quant-ph
On Philomatics and Psychomatics for Combining Philosophy and Psychology with Mathematics
Benyamin Ghojogh, Morteza Babaie
We propose the concepts of philomatics and psychomatics as hybrid combinations of philosophy and psychology with mathematics. We explain four motivations for this combination which are fulfilling the desire of analytical philosophy, proposing science of philosophy, justifying mathematical algorithms by philosophy, and abstraction in both philosophy and mathematics. We enumerate various examples for philomatics and psychomatics, some of which are explained in more depth. The first example is the analysis of relation between the context principle, semantic holism, and the usage theory of meaning with the attention mechanism in mathematics. The other example is on the relations of Plato's theory of forms in philosophy with the holographic principle in string theory, object-oriented programming, and machine learning. Finally, the relation between Wittgenstein's family resemblance and clustering in mathematics is explained. This paper opens the door of research for combining philosophy and psychology with mathematics.
Is bioethics a science?
Gustavo Ortiz Millán
This article enquiries whether normative bioethics can be a science. The article aims to address the conditions of possibility for bioethics to be considered a science, without directly answering the question. The article focuses on two conditions that we typically associate with our common concept of science: truth and knowledge, on the one hand, and naturalization, on the other. Bioethics should be able to provide moral truths and therefore moral knowledge so that we could consider it as a science. On the other hand, the normative character of bioethics raises the question of whether it is possible to naturalize it and make it compatible with a scientific perspective. The article argues that, for normative bioethics to be considered a science, a cognitive and naturalistic stance should be taken on ethics.
Speculative philosophy, Philosophy (General)
Contagions
Paolo Pepe
A hundred years separate two of the most successful masterpieces of English Gothic Fiction: The
Monk (1796) by Matthew Gregory Lewis and Dracula (1897) by Bram Stoker. The significance of
this circumstance goes beyond the mere chronological coincidence and is revealing of a close
connection linking the two texts. Such a connection, made up of a network of allusions, echoes,
anticipations and cross-references, derives from a specific set of narrative situations that The Monk
presents and Dracula redefines in order to reflect new and different axiologies.
These situations are centred on the motif of the Sleeping Beauty and its variations, a narrative topos
whose morbid connotations both novels emphasize in a typically Gothic manner. The analysis of
the ways in which Lewis and Stoker develop this motif sheds light on the dialectical relationship
connecting the two texts, and, with specific reference to Dracula, provides a new interpretative
perspective based on a metaliterary reading of Stoker’s novel, of the dark desires and evil pleasures
it evokes one hundred years after Lewis’s The Monk.
Computational linguistics. Natural language processing, Epistemology. Theory of knowledge
"It's a Trap!"-How Speculation Invariance Can Be Abused with Forward Speculative Interference
Pavlos Aimoniotis, Christos Sakalis, Magnus Själander
et al.
Speculative side-channel attacks access sensitive data and use transmitters to leak the data during wrong-path execution. Various defenses have been proposed to prevent such information leakage. However, not all speculatively executed instructions are unsafe: Recent work demonstrates that speculation invariant instructions are independent of speculative control-flow paths and are guaranteed to eventually commit, regardless of the speculation outcome. Compile-time information coupled with run-time mechanisms can then selectively lift defenses for speculation invariant instructions, reclaiming some of the lost performance. Unfortunately, speculation invariant instructions can easily be manipulated by a form of speculative interference to leak information via a new side-channel that we introduce in this paper. We show that forward speculative interference whereolder speculative instructions interfere with younger speculation invariant instructions effectively turns them into transmitters for secret data accessed during speculation. We demonstrate forward speculative interference on actual hardware, by selectively filling the reorder buffer (ROB) with instructions, pushing speculative invariant instructions in-or-out of the ROB on demand, based on a speculatively accessed secret. This reveals the speculatively accessed secret, as the occupancy of the ROB itself becomes a new speculative side-channel.
Why Choosing Philosophy?
Andrea Vestrucci
This paper is a letter never sent to philosopher, and friend, Ágnes Heller. In this letter I ideally discuss with her the qualities and the defaults of philosophy in contemporary world, while engaging some of her recent positions on the topic. First, I outline some epistemological issues in philosophy, and I confront them with science. Then, I deepen the distinction between academic and public aspects of philosophy, and the “Great Divide” between analytic and continental trends, and I present a possible way to overcome this Divide. Finally, I outline a possible scenario for the future of philosophy.
Speculative philosophy, Ethics
My mother was a… cyborg. Tecnologie e soggettività ibride a confronto
SANTOEMMA, ILARIA
My Mother was a… Cyborg. New technologies and Hybrid Subjectivities
This paper starts from the current querelle regarding the ethical and ontological status of techno-assemblages and embodied subjectivities. Critical aspects of New Technologies have been raised in a fertile debate from different perspectives, above all concerning the cutting-edge fields of life sciences and genetics. From this debate emerges how NT potentiality could act as a device to improve, enhance and exploit the embodied subject. Some of these critics lead to a dualistic understanding of the body, conceived as either natural or artificial. To overcome this dichotomy which polarize the debate, the hereby proposed essay assumes the notion of hybrid subjectivity as a category from which a deeper reflection may set off. Aiming at critically recognizing the multiple relations that the contemporary techno-hybrid subject experiences, the paper will examine different shades and declinations of the hybrid subjectivity, following the two categories of “uncanny” and “enhancement”. The argumentative process will therefore present two ongoing research lines addressing the topics of hybrid subjectivity, also known as the Cyborg: Feminist Critical Posthumanism and Transhumanism. It will be considered how these brunches of thought are respectively connected to A)a teratological idea of the Cyborg and B)an enhanced sight of the artificial hybridization and, consequently, how the two have a different conception of the subjectivity and of technology’s ontological status. The thesis is that the resulting difference could inform the debate on NT by considering the latter a contingence and not the only feature of today’s hybrid forms of life.
Epistemology. Theory of knowledge, Ethics
Theoretical Physics and Indian Philosophy: Conceptual Coherence
Anna Sidorova-Biryukova
The paper addresses the phenomenon of cross-cultural resonance, which arises when ideas coming from different cultures and view systems show mutual correlation, or coherence. We particularly dwell on the parallels between modern physics and Indian classical philosophy. The coherence in ideological, methodological, and ethical spheres is noted and exemplified. Interpretation of correlations in terms of the Jaspers 'ciphers of transcendence' is proposed. A brief survey of studies also dealing with coherence between modern science and ancient teachings is given. In conclusion, a broader perspective of interrelations between rational science and spiritual tradition is discussed.
Reconstructing William Lane Craig's Explanation of Absolute Time based on Mulla Sadra's Philosophy
M. S. Kavyani, H. Razmi, H. Parsania
After the advent of the theory of special relativity, the existence of absolute time in nature was rejected within the society of physics. In recent decades, William Lane Craig has endeavoured to offer an interpretation of the empirical evidence that support the theory of relativity while maintaining the concept of absolute time. His interpretation, however, is based upon supernatural presuppositions due to which it cannot be accepted as a scientific argument. Here, after explaining Craig's view, we attempt to reconstruct his explanation for absolute time using the concept of general substantial motion of nature, well-known in Mulla Sadra's philosophy as the most important approach in Islamic philosophy; thereby, proving general time for the natural world. Although Craig considers some evidence from modern physics in his reasoning for absolute time, in this paper, after pointing to some evidence, it is discussed that the approach used here better bridges the gap that exists between the metaphysics and the physics of the argument.
Antirrealismo e indução
Alexander Brilhante Coelho, Ivã Gurgel
Caracterizamos neste artigo a postura epistemológica do jovem Mário Schenberg, tal como expressada em seu primeiro no trabalho, Os princípios da mecânica, publicado em 1934 pela Revista Polytechnica. Destacamos os diálogos explícitos e implícitos que Schenberg trava com epistemólogos e físicos da transição do século XIX para o XX, particularmente os diálogos com Pierre Duhem e Ernst Mach. À época, Schenberg defende uma epistemologia antirrealista e instrumentalista, contra uma invasão de elementos metafísicos na teoria. O jovem Schenberg defende, ainda, a segurança do processo de teorização por indução, com uma ascensão dos experimentos às leis e das leis a teoria. No momento da publicação do artigo, Schenberg era um estudante de engenharia da Escola Politécnica de São Paulo, recém transferido da Escola de Engenharia de Pernambuco, onde conhecera o professor Luiz Freire. A influência de Freire foi determinante sobre a trajetória científica de Schenberg, que se tornaria o primeiro físico teórico stricto sensu do Brasil. É por meio de Freire que Schenberg se aproxima de uma tradição relativamente marginal de professores das escolas de engenharia que foram construindo, ao longo das primeiras décadas do século XX, uma identidade científica. Esse grupo de professores militava pela “ciência pura”, se contrapondo ao utilitarismo predominante nas escolas politécnicas no período anterior à fundação das universidades. O artigo de Schenberg pode ser lido como um dos últimos trabalhos dessa tradição de engenheiros com identidade científica, um trabalho que, ao mesmo tempo que carrega alguns traços da tradição politécnica, aponta para uma reflexão que só se desenvolveria plenamente com o surgimento de um regime científico disciplinar no interior das faculdades de ciências fundadas na segunda metade dos anos 1930
Epistemology. Theory of knowledge, Science
L’empire de l’involontaire et la volonté de n’être pas gouverné
Orazio Irrera
Dans cet article nous nous interrogerons sur le statut conceptuel ainsi que sur la portée politique de la notion de volonté qui apparait dans la célèbre définition que Foucault donne en 1978 de l’attitude critique comme « volonté de n’être pas gouverné ». Pour en élargir son champ d’intelligibilité nous mettrons en parallèle la généalogie du rapport d’obéissance au sein du pouvoir pastoral et de la gouvernementalité avec la généalogie de la concupiscence et de la chair qui inscrit dans « la structure permanente du sujet » une sorte d’empire de l’involontaire permettant de le gouverner. Nous retracerons la manière dont à partir de l’émergence d’un dispositif médico-juridique à l’intérieur de la pratique pénale où, depuis la moitié du XIXe, s’enchevêtrent les expertises psychiatriques et les dispositifs de normalisation pour manipuler les instincts et ses maladies censées être dangereuses pour la société, Foucault avance l’exigence une nouvelle problématisation de la notion de la volonté. On s’attachera ainsi à mettre en lumière comment cette notion devient le foyer d’une reformulation qui ne peut pas se passer d’une généalogie de l’involontaire que Foucault développe notamment dans ses recherches sur l’Histoire de la sexualité, dont la récente parution du quatrième volume, Les aveux de la chair, nous permet aujourd’hui de saisir l’effective portée théorique et politique de cette articulation de la volonté et de l’involontaire. Celle-ci permet en effet de décrire de manière plus riche et détaillé tant la matrice governamentale de subjectivation en Occident que la constitution d’un horizon d’imputabilité et de responsabilité dont chaque sujet est appelé à répondre, ce qui l’inscrit par ce même geste dans un champ généralisé d’obéissance et le rend ainsi intimement gouvernable.
Speculative philosophy, Philosophy (General)
Majorana equation and its consequences in physics and philosophy
Daniel Parrochia
We focus here on the work of the italian physicist Ettore Majorana, and more particularly on his 1937 article on the symmetrical theory of the electron and the positron, probably one of the most important theory for contemporary thought. We recall the context of this article (Dirac relativistic electron wave equation) and analyze how Majorana deduces his own equation from a very general variational principle. After having rewritten Majorana equation in a more contemporary language, we study its implications in condensed matter physics and their possible applications in quantum computing. Finally, we describe some of the consequences of Majorana approach to philosophy.
Physics for philosophers: Relativity Principle, Inertial Law and faith in what is impossible.
Jorge León de la Vega
<p><strong>Abstract</strong></p><p>An attainable way to understand why we must reasonably doubt about a definite aspect of Albert Einstein´s geometric theory of gravitation, when he denies the character of force for gravity, is throughout the history of Relativity Principle and Inertial Law, from its postulation by Galileo Galilei, its rectification by Newton for the infinite space without resistance to movement, its transformation in the Special Theory of Relativity to receive the Constancy Principle of the Speed of Light, and its final role in the General Theory as a way to explain gravity by means of the sole<br />curvature of space.</p><p><strong>Keywords:</strong> gravedad, inercia, movimiento, teoría, Lógica de la Representación.</p>
Speculative philosophy, Philosophy (General)