scholarly journals Encoding Sequential Information in Semantic Space Models: Comparing Holographic Reduced Representation and Random Permutation

2015 ◽  
Vol 2015 ◽  
pp. 1-18 ◽  
Author(s):  
Gabriel Recchia ◽  
Magnus Sahlgren ◽  
Pentti Kanerva ◽  
Michael N. Jones

Circular convolution and random permutation have each been proposed as neurally plausible binding operators capable of encoding sequential information in semantic memory. We perform several controlled comparisons of circular convolution and random permutation as means of encoding paired associates as well as encoding sequential information. Random permutations outperformed convolution with respect to the number of paired associates that can be reliably stored in a single memory trace. Performance was equal on semantic tasks when using a small corpus, but random permutations were ultimately capable of achieving superior performance due to their higher scalability to large corpora. Finally, “noisy” permutations in which units are mapped to other units arbitrarily (no one-to-one mapping) perform nearly as well as true permutations. These findings increase the neurological plausibility of random permutations and highlight their utility in vector space models of semantics.

2017 ◽  
Vol 21 (3) ◽  
pp. 679-695 ◽  
Author(s):  
Ángel Hernández-Castañeda ◽  
Hiram Calvo

Author(s):  
Carlos Zequeira Sánchez ◽  
Evaristo José Madarro Capó ◽  
Guillermo Sosa-Gómez

In various scenarios today, the generation of random permutations has become an indispensable tool. Since random permutation of dimension [Formula: see text] is a random element of the symmetric group [Formula: see text], it is necessary to have algorithms capable of generating any permutation. This work demonstrates that it is possible to generate the symmetric group [Formula: see text] by shifting the components of a particular matrix representation of each permutation.


2009 ◽  
Vol 53 (5) ◽  
pp. 389-398 ◽  
Author(s):  
Diederik Aerts ◽  
Marek Czachor ◽  
Bart De Moor

2018 ◽  
Vol 39 (3) ◽  
pp. 1246-1275 ◽  
Author(s):  
Ching-pei Lee ◽  
Stephen J Wright

Abstract Variants of the coordinate descent approach for minimizing a nonlinear function are distinguished in part by the order in which coordinates are considered for relaxation. Three common orderings are cyclic (CCD), in which we cycle through the components of $x$ in order; randomized (RCD), in which the component to update is selected randomly and independently at each iteration; and random-permutations cyclic (RPCD), which differs from CCD only in that a random permutation is applied to the variables at the start of each cycle. Known convergence guarantees are weaker for CCD and RPCD than for RCD, though in most practical cases, computational performance is similar among all these variants. There is a certain type of quadratic function for which CCD is significantly slower than for RCD; a recent paper by Sun & Ye (2016, Worst-case complexity of cyclic coordinate descent: $O(n^2)$ gap with randomized version. Technical Report. Stanford, CA: Department of Management Science and Engineering, Stanford University. arXiv:1604.07130) has explored the poor behavior of CCD on functions of this type. The RPCD approach performs well on these functions, even better than RCD in a certain regime. This paper explains the good behavior of RPCD with a tight analysis.


Fractals ◽  
2007 ◽  
Vol 15 (02) ◽  
pp. 105-126 ◽  
Author(s):  
YINGCHUN ZHOU ◽  
MURAD S. TAQQU

Bucket random permutations (shuffling) are used to modify the dependence structure of a time series, and this may destroy long-range dependence, when it is present. Three types of bucket permutations are considered here: external, internal and two-level permutations. It is commonly believed that (1) an external random permutation destroys the long-range dependence and keeps the short-range dependence, (2) an internal permutation destroys the short-range dependence and keeps the long-range dependence, and (3) a two-level permutation distorts the medium-range dependence while keeping both the long-range and short-range dependence. This paper provides a theoretical basis for investigating these claims. It extends the study started in Ref. 1 and analyze the effects that these random permutations have on a long-range dependent finite variance stationary sequence both in the time domain and in the frequency domain.


Author(s):  
Kamel Mohammed Faraoun

This paper proposes a semantically secure construction of pseudo-random permutations using second-order reversible cellular automata. We show that the proposed construction is equivalent to the Luby-Rackoff model if it is built using non-uniform transition rules, and we prove that the construction is strongly secure if an adequate number of iterations is performed. Moreover, a corresponding symmetric block cipher is constructed and analysed experimentally in comparison with popular ciphers. Obtained results approve robustness and efficacy of the construction, while achieved performances overcome those of some existing block ciphers.


2007 ◽  
Vol DMTCS Proceedings vol. AH,... (Proceedings) ◽  
Author(s):  
Guillaume Chapuy

International audience Let $\sigma$ be a random permutation chosen uniformly over the symmetric group $\mathfrak{S}_n$. We study a new "process-valued" statistic of $\sigma$, which appears in the domain of computational biology to construct tests of similarity between ordered lists of genes. More precisely, we consider the following "partial sums": $Y^{(n)}_{p,q} = \mathrm{card} \{1 \leq i \leq p : \sigma_i \leq q \}$ for $0 \leq p,q \leq n$. We show that a suitable normalization of $Y^{(n)}$ converges weakly to a bivariate tied down brownian bridge on $[0,1]^2$, i.e. a continuous centered gaussian process $X^{\infty}_{s,t}$ of covariance: $\mathbb{E}[X^{\infty}_{s,t}X^{\infty}_{s',t'}] = (min(s,s')-ss')(min(t,t')-tt')$.


2012 ◽  
Vol 21 (5) ◽  
pp. 715-733 ◽  
Author(s):  
ALEXANDER GNEDIN ◽  
ALEXANDER IKSANOV ◽  
ALEXANDER MARYNYCH

We consider random permutations derived by sampling from stick-breaking partitions of the unit interval. The cycle structure of such a permutation can be associated with the path of a decreasing Markov chain on n integers. Under certain assumptions on the stick-breaking factor we prove a central limit theorem for the logarithm of the order of the permutation, thus extending the classical Erdős–Turán law for the uniform permutations and its generalization for Ewens' permutations associated with sampling from the PD/GEM(θ)-distribution. Our approach is based on using perturbed random walks to obtain the limit laws for the sum of logarithms of the cycle lengths.


2013 ◽  
Vol 23 (2) ◽  
pp. 201-222 ◽  
Author(s):  
OLIVIER BERNARDI ◽  
ROSENA R. X. DU ◽  
ALEJANDRO H. MORALES ◽  
RICHARD P. STANLEY

We study the mixing properties of permutations obtained as a product of two uniformly random permutations of fixed cycle types. For instance, we give an exact formula for the probability that elements 1,2,. . .,k are in distinct cycles of the random permutation of {1,2,. . .,n} obtained as a product of two uniformly random n-cycles.


Sign in / Sign up

Export Citation Format

Share Document